Ava’s Final Project Report

Author

Ava Serin

Published

November 26, 2023

Code
# Suppress all warnings
import warnings
warnings.simplefilter("ignore")
import warnings
from statsmodels.tools.sm_exceptions import ConvergenceWarning
warnings.simplefilter('ignore', ConvergenceWarning)

# Importing packages
import pandas as pd
import numpy as np
import datetime as dt
import matplotlib.pyplot as plt
import seaborn as sns
import statsmodels.api as sm
import holidays
import xgboost as xgb
import keras 
import itertools

from pandas.plotting import autocorrelation_plot, lag_plot

from statsmodels.graphics.tsaplots import plot_acf, plot_pacf
from statsmodels.tsa.arima.model import ARIMA
from statsmodels.tsa.stattools import adfuller
from statsmodels.tsa.statespace.sarimax import SARIMAX
from statsmodels.tsa.stattools import adfuller
from statsmodels.tools.eval_measures import rmse

from pmdarima.arima import auto_arima

from scipy.stats import zscore

from sklearn.metrics import mean_squared_error, mean_absolute_error, r2_score
from sklearn.preprocessing import MinMaxScaler
from sklearn.model_selection import train_test_split, TimeSeriesSplit, RandomizedSearchCV, GridSearchCV, cross_val_score
from sklearn.feature_selection import SelectFromModel
from sklearn.decomposition import PCA

import prophet
from prophet import Prophet
from prophet.diagnostics import cross_validation, performance_metrics
from prophet.make_holidays import make_holidays_df

from xgboost import plot_importance, plot_tree, XGBRegressor

from keras.layers import LSTM, Dense, Dropout, Input, Bidirectional, BatchNormalization
from keras.models import Model, Sequential
from keras.callbacks import EarlyStopping, LearningRateScheduler, ModelCheckpoint
from keras.regularizers import l1_l2
from keras.optimizers import Adam

from math import sqrt

plt.style.use('fivethirtyeight')

# Loading data
df = pd.read_csv('initial_data2.csv')

# Converting Date column to Datetime object
df['Date'] = pd.to_datetime(df['Date'])

1 Ava’s Time Series Vaccine Rate Prediction Project Final Report

1.1 I. Abstract

The objective of this project is to use various time-series modeling techniques to predict the percentage of the United States’ states and territories whose citizens have received their first booster COVID-19 vaccination dosage. I conducted extensive exploratory data analysis to uncover insights on the data such as variable distributions and feature interactions before performing data cleaning by changing data frequency, imputing null values, and adding engineered features among other processes. Next, six models, ARIMA, auto ARIMA, univariate Prophet, multivariate Prophet, XGBoost, and Keras LSTM are developed, trained, and tuned on the vaccination data. Notably, many of the models suffered from overfitting and other issues due to the cumulative nature of the dataset and the size of it. The manually trained ARIMA model emerged as the best-performing model as indicated by the lowest root mean squared error (RMSE) as it was able to approach the modeling process with simplicity and handle seasonal components. However, this model also had unusual results in the train RMSE being greater than that of the test set. Some other findings were that the vaccination rate of specific age groups and of specific manufacturers are imperative in predicting overall vaccination rates. As for the working dynamics, during our project, our team effectively divided work and utilized each other’s strengths, meeting both in person and over Zoom for complex tasks like debugging. This experience taught me the importance of strategic division of responsibilities and leveraging individual strengths for efficient collaboration.

1.2 II. Project and Data Overview

1.2.1 A. Project Overview

Using a CDC database of weekly-reported vaccine equity data at a United States state level, we seek to predict the percent of people in a county who have completed a primary series of the COVID-19 vaccination and received a booster dose. This data will be cleaned and organized for use in a time series prediction model. Some of the predictors for this project include age group vaccination rates, specific manufacturere vaccination rate, and location. Users of the model may include vaccine manufacturers who are seeking data on specific geographical places or demographics that they should target their advertisement towards. For example, should our analysis reveal that high vaccination rates among children under 12 strongly correlate with overall vaccination coverage, manufacturers might be influenced to focus their marketing efforts on families. Additionally, stakeholders can gain an understanding of the impact certain features have on locations reaching near 100% booster vaccination completion or when this might occur.

1.2.2 B. Data Overview and Preprocessing

1.2.2.1 1. Data Collection:

We are using data collected by the Centers for Disease Control and Prevention (CDC). These data are made accessible through the CDC’s Application Programming Interface (API).

1.2.2.2 2. Data Cleaning:

Imputing missing values and removing redundant features

Our goal for this project is to predict the percentage of the population that has received the initial booster. With this objective in mind, we identified missing data, deleted redundant columns, and investigated outliers. We eliminated COVID-19 vaccination features with more than 1,000 missing values, as they relate to the bivalent booster or second booster distribution. The second booster was introduced about a year after the initial booster. To avoid data leakage, we ensured that data regarding the second booster doses are absent, given that these vaccines weren’t available at the commencement of our dataset.

There were columns representing both the proportion of vaccinated people in a state and the actual number of people who received the vaccine. Since these essentially measured the same metric, albeit at different scales, we felt it redundant. Hence, we discarded the count features and retained the proportion columns, ensuring consistent scaling across states.

Furthermore, a significant portion of data before November 2nd, 2021, was missing. Research revealed that this date aligned with the CDC’s recommendation for children aged five to eleven to receive the vaccine (Kates et al., 2021). This led us to adjust our dataset’s starting point to this date for consistency. We observed a significant number of missing entries for December 14th, 2022. While the cause remains unclear, our research into time series imputation techniques led us to select the Last Observation Carried Forward (LOCF) method (Abulkhair, 2023). Consequently, we used the data from December 7th, 2022, to fill the gaps for those states with incomplete data on December 14th, 2022.

Code
# Find NaN value counts
missing_counts = df.isna().sum()

# Sort the missing value counts in descending order
missing_counts_sorted = missing_counts.sort_values(ascending=False)

# columns with over 1000 missing values
columns_with_over_1000_missing = missing_counts_sorted[missing_counts_sorted > 1000].index

# remove columns with over 1000 missing
df = df.drop(columns=columns_with_over_1000_missing)

# list of numerical columns wihh equivalent percentage columns to drop
columns_to_drop = [
       'Administered_Dose1_Recip',   
       'Administered_Dose1_Recip_5Plus',
       'Administered_Dose1_Recip_12Plus',  
       'Administered_Dose1_Recip_18Plus',
       'Administered_Dose1_Recip_65Plus', 
        'Series_Complete_Yes',
        'Series_Complete_5Plus',
        'Series_Complete_12Plus',
        'Series_Complete_18Plus',
       'Series_Complete_65Plus',
       'Additional_Doses_18Plus', 
       'Additional_Doses_50Plus', 
       'Additional_Doses_65Plus']

# Dropping the columns from the df
df = df.drop(columns = columns_to_drop)

# Defining response variable for easier 
pred_var = 'Additional_Doses_Vax_Pct' 

given_date = pd.to_datetime('2021-11-02') 

df = df[df['Date'] > given_date]

specific_day = '2022-12-14'  

specific_day_data = df.loc[df['Date'] == specific_day]

rows_with_missing_values = specific_day_data[specific_day_data.isnull().any(axis=1)]

location_values = rows_with_missing_values['Location'].tolist()

# Month column
df['month'] = df['Date'].dt.month

# Year column
df['year'] = df['Date'].dt.year

# Filter the DataFrame for dates in December 2022
december_2022_data = df[(df['year'] == 2022) & (df['month'] == 12)]

for location in location_values:
    # Subset data for the specific location
    location_data = df[df['Location'] == location]
    
    # Subset data for the specific dates
    dates_to_impute = location_data[location_data['Date'].isin(['2022-12-07', '2022-12-14'])]
    
    # Perform forward fill (LOCF) imputation for the specific location and dates
    imputed_data = dates_to_impute.bfill()
    
    # Update the original DataFrame with the imputed data for the current location
    df.loc[imputed_data.index, imputed_data.columns] = imputed_data

1.2.2.3 3. Temporal Aggregation:

Upon conducting a deeper analysis of the data, we discovered a shift in June 2022, where the API transitioned from daily to weekly reporting. To maintain consistency, we chose to resample our dataset to capture weekly observations each Wednesday, aligning with the new reporting pattern established post-June 2022.

Code
june_2022_data = df[(df['year'] == 2022) & (df['month'] == 6)]

dec_2021_data = df[(df['year'] == 2021) & (df['month'] == 12)]

df['day_of_week'] = df['Date'].dt.day_name()

# Identifying day of week
given_date = pd.to_datetime('2022-06-22') 
days = df[df['Date'] > given_date]

df = df[df['day_of_week'] == 'Wednesday']

1.2.2.4 4. Outlier Detection

Segmented Analysis Outlier Detection on Aggregated Data

For outlier detection, we used the average for each feature across observations for each date so that we could make the date the index. We decided to use segmented analysis for outlier detection which breaks the dataset into monthly segments and calculates the interquartile range (IQR) for each segment. This can help identify if outliers are specific to certain months because the rate of vaccination varies greatly month-to-month. Using this technique, we identified one outlier in our dataset which represents the response variable at the end of June 2022. However, I believe this outlier corresponds to the major public health announcement made by the U.S. Food and Drug Administration (FDA) regarding the recommendation to include the Omicron BA.4/5 component for COVID-19 vaccine booster doses and for the general public to obtain a booster dosage (Marks, 2022). Therefore, I believe this relative spike (which appears to be incredibly minimal) correlated with an external event is justified and a representation of the true variability in the data. Removing it, in my eyes, could lead to a loss of information.

Code
avg_vax_pct_per_day = df.groupby('Date')['Additional_Doses_Vax_Pct'].mean().reset_index()
# Convert 'Date' to datetime format
avg_vax_pct_per_day['Date'] = pd.to_datetime(avg_vax_pct_per_day['Date'])

# Create a month-year column for segmentation
avg_vax_pct_per_day['Month_Year'] = avg_vax_pct_per_day['Date'].dt.to_period('M')

# Group by Month_Year and calculate IQR for each month
iqr_values = avg_vax_pct_per_day.groupby('Month_Year')['Additional_Doses_Vax_Pct'].apply(lambda x: (x.quantile(0.25), x.quantile(0.75))).reset_index()
iqr_values.columns = ['Month_Year', 'IQR_Values']
iqr_values['Q1'] = iqr_values['IQR_Values'].apply(lambda x: x[0])
iqr_values['Q3'] = iqr_values['IQR_Values'].apply(lambda x: x[1])
iqr_values['Lower_Bound'] = iqr_values['Q1'] - 1.5 * (iqr_values['Q3'] - iqr_values['Q1'])
iqr_values['Upper_Bound'] = iqr_values['Q3'] + 1.5 * (iqr_values['Q3'] - iqr_values['Q1'])

# Merge the IQR values back to the main dataframe
avg_vax_pct_per_day = pd.merge(avg_vax_pct_per_day, iqr_values, on='Month_Year')

# Determine if a data point is an outlier for its respective month
avg_vax_pct_per_day['is_segmented_outlier'] = (avg_vax_pct_per_day['Additional_Doses_Vax_Pct'] < avg_vax_pct_per_day['Lower_Bound']) | (avg_vax_pct_per_day['Additional_Doses_Vax_Pct'] > avg_vax_pct_per_day['Upper_Bound'])
# Scatter plot to see segmented analysis outliers
plt.figure(figsize=(15, 6))

# Plot non-outliers in blue and outliers in red
plt.scatter(avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == False]['Date'], 
            avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == False]['Additional_Doses_Vax_Pct'], 
            color='blue', s=5, label='Regular Data Point')

plt.scatter(avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == True]['Date'], 
            avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == True]['Additional_Doses_Vax_Pct'], 
            color='red', s=5, label='Segmented Outlier')

plt.title('Segmented Outliers Detection in Average Additional Doses Vax Pct per Day')
plt.xlabel('Date')
plt.ylabel('Average Additional Doses Vax Pct')
plt.legend()
plt.grid(True)
plt.tight_layout()
plt.show()

1.2.2.5 5. Feature Engineering:

In our time-series analysis, we recognized the value of feature engineering to uncover potential predictors not explicitly present in the CDC’s API. Consequently, we integrated columns indicating the quarter, month, year, day of the week, day of the month, day of the year, and week of the year in which each observation was taken. Additionally, we established columns denoting the season of the observation (Winter, Spring, Fall, or Summer). Finally, we incorporated a Boolean column to indicate if the week of the observation encompassed a holiday, as per the holidays Python library, and another to denote if it contained a vaccine announcement by the CDC (Montel, 2017; Hahn, n.d.).

To explore time trends in prediction variables over time, we have had to group the data by date. This was necessary as otherwise the data contains multiple entries for each date for each state. To investigate lag we have plotted an ACF graph. The pattern the autocorrelation function (ACF) plot exhibited is commonly observed in time series data with a strong short-term memory or persistence. It implied that the most recent values have a more pronounced impact on the current value, and the impact of earlier values diminishes gradually. The decay in autocorrelation suggests a relatively fast decrease in correlation with increasing time lags. To further investigate the lag we have plotted the partial autocorrelation function (PACF) graph which showed the most significant lag at value of one week. Thus we have created a lag variable with shift of one week. Notably, autoregressive integrated moving average (ARIMA) models intrinsically factor in such dependencies.

Code
# Quarter column
df['quarter'] = df['Date'].dt.quarter

# Day of year column
df['dayofyear'] = df['Date'].dt.dayofyear

# Day of month column
df['dayofmonth'] = df['Date'].dt.day

# Week of year column
df['weekofyear'] = df['Date'].dt.isocalendar().week.astype(np.int64)

# Defining function to identify season
def get_season(date):
    month = date.month
    day = date.day
    if month in [3, 4, 5]:
        season = 'spring'
    elif month in [6, 7, 8]:
        season = 'summer'
    elif month in [9, 10, 11]:
        season = 'fall'
    else:
        season = 'winter'
    

    if month == 3 and day < 20:
        season = 'winter'
    elif month == 6 and day < 21:
        season = 'spring'
    elif month == 9 and day < 22:
        season = 'summer'
    elif month == 12 and day < 21:
        season = 'fall'
    
    return season

# Applying function and creating season column
df['season'] = df['Date'].apply(get_season)

# Create a list of US holidays for the given year range in the dataframe
us_holidays = holidays.US(years=[df['Date'].dt.year.min(), df['Date'].dt.year.max()]).keys()

# Convert us_holidays to a pandas Series of datetime objects
us_holidays_series = pd.Series(pd.to_datetime(list(us_holidays)))

# Create Holiday column
df['holidays'] = df['Date'].isin(us_holidays_series) | (df['Date'] + pd.Timedelta(days=1)).isin(us_holidays_series)
df['holidays'] = df['holidays'].replace({True: 'Holiday', False: 'Normal day'})

# Determine which weeks have a holiday
holiday_weeks = us_holidays_series.dt.strftime('%U-%Y').unique()

# Assign a "holiday season" for every date that's within a week having a holiday
df['holiday_season'] = df['Date'].dt.strftime('%U-%Y').isin(holiday_weeks)
Code
# Define a list of unique announcement dates
announcement_dates = [
    "04/28/2023", "04/27/2023", "04/18/2023", "03/14/2023", "03/10/2023",
    "12/16/2022", "12/08/2022", "10/21/2022", "10/12/2022", "09/13/2022",
    "08/31/2022", "08/26/2022", "08/19/2022", "07/13/2022", "07/08/2022",
    "06/30/2022", "06/17/2022", "05/17/2022", "05/05/2022", "04/29/2022",
    "04/15/2022", "04/01/2022", "03/29/2022", "03/21/2022", "03/11/2022",
    "02/11/2022", "02/01/2022", "01/31/2022", "01/11/2022", "01/07/2022",
    "01/03/2022", "12/17/2021", "12/14/2021", "12/09/2021", "11/30/2021",
    "11/19/2021", "10/29/2021", "10/26/2021", "10/22/2021", "10/20/2021",
    "10/14/2021", "10/01/2021", "09/24/2021", "09/22/2021", "09/20/2021",
    "09/17/2021", "09/10/2021", "09/02/2021", "09/01/2021", "08/24/2021",
    "08/23/2021", "08/18/2021", "08/13/2021", "08/12/2021", "08/06/2021",
    "08/03/2021", "07/30/2021", "07/16/2021", "07/13/2021", "07/08/2021",
    "07/06/2021", "07/02/2021", "06/29/2021", "06/25/2021", "06/15/2021",
    "06/11/2021", "06/10/2021", "05/25/2021", "05/19/2021", "05/11/2021",
    "05/10/2021", "04/27/2021", "04/23/2021", "04/21/2021", "04/16/2021",
    "04/13/2021", "04/12/2021", "04/01/2021", "03/26/2021", "03/24/2021",
    "03/17/2021", "03/05/2021", "03/02/2021", "02/27/2021", "02/26/2021",
    "02/25/2021", "02/23/2021", "02/22/2021", "02/12/2021", "02/05/2021",
    "02/04/2021", "01/29/2021", "01/14/2021", "01/04/2021", "12/28/2020",
    "12/22/2020", "12/21/2020", "12/18/2020", "12/17/2020", "12/14/2020", "12/12/2020"
]

# Convert to datetime and deduplicate
announcement_dates = list(set([pd.to_datetime(date) for date in announcement_dates]))

# Convert announcement dates to week-year format
announcement_weeks = [date.strftime('%U-%Y') for date in announcement_dates]

# Check if the date in the dataset is within the same week of any announcement dates
def in_announcement_week(date):
    return date.strftime('%U-%Y') in announcement_weeks

# Create the 'vax_announcement' column
df['vax_announcement'] = df['Date'].apply(in_announcement_week)

1.2.2.6 6. Exploratory Data Analysis (EDA)

Temporal Visualizations & Seasonal Decomposition

We have used the seasonal and trend decomposition using Loess (STL) to investigate potential trends, seasons and residuals. Based on the STL plot, we have learned that Additional_Doses_Vax_Pct has a very steep increase in the first four to five months after the booster’s initial release, and then the rate tapered and increased at a small and steady rate. This was expected as one might consider that most people who wanted the booster, receved it when it first came out. The seasonal plot provides clear evidence for a seasonal pattern of around three months. This pattern is something we kept in mind and explored further in variable analysis. We will account for this pattern in a variety of ways moving forward with the project. For example one of the solutions we employ is to use an ARIMA model which can account for seasonal components. However, for other models we have creaed a categorical Season variable. Lastly, the residual pattern suggests that the STL may not have adequately captured some underlying patterns or structures in our time series data.

Code
# STL decomposition to investigate trends, seasons and residual

# group data by date as there are multiple entires per each date
time_series_data = df.groupby('Date')[pred_var].mean().reset_index()
# set index to date
time_series_data = time_series_data.set_index('Date')

# Perform STL decomposition with a seasonality period of 7 because data are reported weekly
result = sm.tsa.seasonal_decompose(time_series_data[pred_var], model='stl', period=7)

# Access the decomposed components
trend = result.trend
seasonal = result.seasonal
residual = result.resid

# Plot the original time series, trend, seasonal, and residual components
plt.figure(figsize=(12, 8))

# Plot a subset of data 
plt.subplot(4, 1, 1)
plt.plot(time_series_data[pred_var], label='Original Time Series')
plt.legend()
plt.title('Time Series Over Time')
plt.xlabel('Date')
plt.ylabel(pred_var)


plt.subplot(4, 1, 2)
plt.plot(trend, label='Trend')
plt.legend()
plt.title('Trends in Time Series')
plt.xlabel('Date')
plt.ylabel(pred_var)



plt.subplot(4, 1, 3)
plt.plot(seasonal, label='Seasonal')
plt.legend()
plt.title('Seasonal Trends in Time Series')
plt.xlabel('Date')

plt.subplot(4, 1, 4)
plt.plot(residual, label='Residual')
plt.legend()
plt.title('Residuals in Time Series')
plt.xlabel('Date')

# Customize x-axis labels to rotate by 45 degrees
plt.xticks(rotation=45)

plt.tight_layout()
plt.show()

Correlation Analysis

This ACF pattern is commonly observed in time series data with a strong short-term memory or persistence. It implies that the most recent values have a more pronounced impact on the current value, and the impact of earlier values diminishes gradually. The decay in autocorrelation suggests a relatively fast decrease in correlation with increasing time lags. Autoregressive models are ideal for dealing with this particular autocorrelation pattern. To investigate this further we have looked at the PACF graph and identified the biggest spike at value of one week. To prevent correlation issues in our model I will experiement with adding lag terms such as one week.

Code
# PACF Plot

# Calculate the PACF
pacf = sm.tsa.pacf(time_series_data, nlags=25)

# Create the PACF plot
plt.figure(figsize=(12, 6))
plt.bar(range(len(pacf)), pacf)
plt.xlabel('Lag')
plt.ylabel('Partial Autocorrelation')
plt.title('Partial Autocorrelation Function (PACF)')
plt.grid(True)
plt.show()

Below, I add the one week lag as indicated to do so by the PACF graph. This is the final preprocessing step I took, and I exported the preprocessed dataframe for ease of use across all of my models. Therefore, the dataframe I will use and reference in the model development section and beyond will be 'df_post_eda.csv'.

Code
# Adding one week lag
df['Additional_Doses_Vax_Pct_1_w_lag'] = df['Additional_Doses_Vax_Pct'].shift(1)

1.2.2.7 Univariate Analysis

Distribution of Response Variable

Here, we can see that the response variable is skewed to the left and that the most significant concentration of data lies between the 30% to 50% vaccination rate, suggesting that for many samples, the percentage of additional doses administered falls within this range. It’s worth noting the scarcity of data points both below 10% and above 60%. This indicates that very low and very high vaccination rates are less common among the samples we have.

Code
# Distribution of response variable
sns.histplot(df[pred_var], kde=False )
<Axes: xlabel='Additional_Doses_Vax_Pct', ylabel='Count'>

Distribution of features after data cleaning and imputation

We can see that many of the features are relatively normally distributted with some having an extreme skew.

Code
# Distribution of features after data cleaning and imputation

# find continous/ numerical variables
continuous_vars = df.select_dtypes(include=['float64', 'int64']).columns.tolist()

# plot df
%matplotlib inline
df.hist (column= continuous_vars,figsize= (50,30))
#hides array names that are otherwise printed
_ = plt.plot()

Distribution of feature-engineered season

We can see that there are more observations from the winter. This may have been because of where we start and end out data as a result of vaccine guidelines for 5-11 year olds.

Code
# Distribution of season 
categorical_variable = 'season'

# Create a countplot
plt.figure(figsize=(20, 6))  
sns.countplot(data=df, x=categorical_variable, palette='viridis')  
plt.title(f'Distribution of {categorical_variable}')
plt.xlabel(categorical_variable)
plt.ylabel('Count')

# Rotate x-axis labels for better readability 
plt.xticks(rotation=45)

# Show the plot
plt.show()

Distribution of feature-engineered holiday_season

We can observe that relatively few vaccination rates were reported in weeks when there was a US holiday.

Code
# Custom Boolean color palette
boolean_palette = {True: 'green', False: 'red'}

# Distribution of holidays
categorical_variable = 'holiday_season'

# Create a countplot
plt.figure(figsize=(20, 6))  
sns.countplot(data=df, x=categorical_variable, palette=boolean_palette) 
plt.title(f'Distribution of {categorical_variable}')
plt.xlabel(categorical_variable)
plt.ylabel('Count')

# Rotate x-axis labels for better readability 
plt.xticks(rotation=45)

# Show the plot
plt.show()

Distribution of feature-engineered vax_announcement

There are a pretty significant proportion of vaccine rate observations on a week where there was a CDC vaccine announcement. This could be because there were a lot of announcements reported, though.

Code
# Distribution of doses near vaccine announcements
categorical_variable = 'vax_announcement'

# Create a countplot
plt.figure(figsize=(20, 6))  # Set the figure size
sns.countplot(data=df, x=categorical_variable, palette=boolean_palette)  
plt.title(f'Distribution of {categorical_variable}')
plt.xlabel(categorical_variable)
plt.ylabel('Count')

# Rotate x-axis labels for better readability
plt.xticks(rotation=45)

# Show the plot
plt.show()

Distribution of Location

The observations across locations are almost completely even with around 15 less reports from Palau and around 60 less reports from the location code RP (we were unable to find this location’s corresponding state/territory name).

1.2.2.8 Bivariate Analysis

To further investigate the seasonal trends found in the STL plots we have plotted box plots of Month and Season against our prediction variable. Based on these plots we can see that the median across all categories is pretty similar. However, both November and Fall have a significanly larger IQR. This is potentially related to the fact that our data subset starts in Novemember (Fall), meaning that it had a lot of low percentage of values in 2021 when the COVID booster first came out.

Code
# visualize the monthly pred_var
features_target = df[['day_of_week', 'quarter', 'month', 'year', 'dayofyear', 'dayofmonth', 'weekofyear','season', 'holidays', 'holiday_season', 'vax_announcement','Additional_Doses_Vax_Pct_1_w_lag', pred_var,'Date']]
features_target = features_target.set_index('Date')
fig, ax = plt.subplots(figsize=(10, 8))
sns.boxplot(data=features_target, x='month', y=pred_var, palette='Blues')
ax.set_title('Booster Doses by Month')
plt.show()

Code
fig, ax = plt.subplots(figsize=(10, 8))
sns.boxplot(data=features_target, x='season', y=pred_var, palette='Blues')
ax.set_title('Booster Doses by Season')
plt.show()

1.2.2.9 Multivariate Analysis

Based on multivariate heatmaps there are few variables that have relatively high correlation with our prediction variable. These features may have contributed to some of the overfitting issues I had with model development.

Code
# Heat map to show correlation between variables

plt.figure(figsize=(10, 8))  
sns.heatmap(df.corr(), cmap='coolwarm', linewidths=0.5)

plt.show()

Code
# Engineered feature correlations

correlation = features_target.corr( method='pearson' )
sns.heatmap( correlation )
<Axes: >

1.3 III. Methodology

1.3.1 A. ARIMA Model

1.3.1.1 1. Data Preparation:

For the Autoregressive Integrated Moving Average Prediction (ARIMA) model, I imported solely the Date and response variable columns as the model inherently does not take any other features (Munichiello, 2023). I then grouped Date by location as ARIMA models must have one unique observation per date. Finally, I scaled the data as that has improved all of the models.

Code
# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Import data with specific columns
df = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime and group by 'Date'
df['Date'] = pd.to_datetime(df['Date'])
df = df.groupby('Date')[pred_var].mean()

# Sorting the DataFrame by the index
df.sort_index(inplace=True)

# Calculate the index for the 70-30 split
split_index = int(len(df) * 0.7)

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_scaled = pd.DataFrame(scaler.fit_transform(df.values.reshape(-1, 1)), index=df.index, columns=[pred_var])

To check the stationarity of my data, I performed the Augmented Dickey-Fuller test to see if the \(p-value ≤ 0.05\) meaning the data does not have a unit root. I also created an autocorrelation plot to show that, after around 11 lags, the autocorrelation remained between 0.25 and -0.25. Although the data passed this test, I know that stationary data have a property that the mean, variance and autocorrelation structure do not change over time (National Institute of Standards and Technology (NIST), n.d.). It is clear from the graph that both the mean and standard devation change over time. This may be because the vaccination rate was increasing so rapidly in the beginning of our dataset beforetapering off as more people got vaccinated in each Location. I believe the ADF test did not reflect this because of the cumulative nature of the dataset. For this reason, I assumed my data to be non-stationary.

Code
# Perform Augmented Dickey-Fuller test:
def test_stationarity(timeseries):

    # Determing rolling statistics
    rolling_mean = timeseries.rolling(window=12).mean()
    rolling_std = timeseries.rolling(window=12).std()

    # Plot rolling statistics:
    plt.plot(timeseries, color='blue',label='Original')
    plt.plot(rolling_mean, color='red', label='Rolling Mean')
    plt.plot(rolling_std, color='black', label = 'Rolling Std')
    plt.legend(loc='best')
    plt.title('Rolling Mean & Standard Deviation')
    plt.show(block=False)
    
    # Perform Augmented Dickey-Fuller test:
    print('Results of Dickey-Fuller Test:')
    adf_test = adfuller(timeseries, autolag='AIC')
    adf_output = pd.Series(adf_test[0:4], index=['Test Statistic','p-value','#Lags Used','Number of Observations Used'])
    for key,value in adf_test[4].items():
        adf_output['Critical Value (%s)' % key] = value
    print(adf_output)

# Testing
test_stationarity(df_scaled[pred_var])

#Autocorrelation plot
autocorrelation_plot(df_scaled[pred_var])

Results of Dickey-Fuller Test:
Test Statistic                 -4.009253
p-value                         0.001363
#Lags Used                      2.000000
Number of Observations Used    77.000000
Critical Value (1%)            -3.518281
Critical Value (5%)            -2.899878
Critical Value (10%)           -2.587223
dtype: float64
<Axes: xlabel='Lag', ylabel='Autocorrelation'>

ARIMA models are defined by several key parameters such as order and seasonal_order for seasonal data (SARIMA). Their descriptions are as follows:

  • order: This parameter is a tuple (p, d, q).
    • Lag order (p): Refers to the number of lag observations included in the model, or the number of past values used for predicting the future values.
    • Degree of differencing (d): Indicates the number of times that the raw observations are differenced. This helps in making the time series stationary.
    • Moving average order (q): Represents the size of the moving average window, or the number of lagged forecast errors that should be included in the ARIMA model.
  • seasonal_order: This optional parameter is a tuple (P, D, Q, s) and is used for the seasonal component of the model.
    • Seasonal auto-regressive order (P): Similar to p, but for the seasonal component of the model. It represents the number of seasonal lags of the autoregressive model.
    • Seasonal differencing (D): Similar to d, but for the seasonal component. It refers to the number of times the seasonal differences are taken to make the series stationary.
    • Seasonal moving average order (Q): Similar to q, but for the seasonal component. It indicates the number of seasonal moving average terms.
    • Time span of repeating seasonal pattern (s): Denotes the length of the seasonal cycle (Munichiello, 2023; 4.1 Seasonal ARIMA Models | STAT 510, n.d.).

1.3.1.2 2. Model Building

I began by splitting my data into a 70-30 train test split. Then, to develop my ARIMA model, it was important for me to analyze the Auto-Correlation Function (ACF) and Partial Auto-Correlation Function (PACF) plots to give me insight into potential p and q parameters. Since the ACF plot hits zero autocorrelation at around lag 14, it is clear that the effects of past values on the current value becomes negligible after about 14 periods. As for the PACF plot, it is clear that the autocorrelation drops below zero at lag four.

Code
# Calculate the index for the 70-30 split
split_index = int(len(df_scaled) * 0.7)

# Split into scaled and differenced train and test sets
train_ar = df_scaled.iloc[:split_index]
test_ar = df_scaled.iloc[split_index:]

# Plot ACF and PACF
plt.figure(figsize=(12, 6))
plt.subplot(121)
plot_acf(train_ar, ax=plt.gca(), lags=25)
plt.subplot(122)
plot_pacf(train_ar, ax=plt.gca(), lags=25)
plt.show()

Based on the plot results, I wanted to start with a lower q value and then experiment with higher values if necessary. Furthermore, I will start with \(p = 3\) as the PACF is significant at lag 3. I also included some other preliminary model specifications in the ARIMA Preliminary Models section of the appendix.

Code
# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(3, 0, 1))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
fitted_model_ar1.summary()
SARIMAX Results
Dep. Variable: Additional_Doses_Vax_Pct No. Observations: 56
Model: ARIMA(3, 0, 1) Log Likelihood 192.073
Date: Mon, 27 Nov 2023 AIC -372.146
Time: 00:13:15 BIC -359.993
Sample: 11-03-2021 HQIC -367.434
- 11-23-2022
Covariance Type: opg
coef std err z P>|z| [0.025 0.975]
const 0.5959 0.148 4.036 0.000 0.307 0.885
ar.L1 1.1266 0.189 5.967 0.000 0.757 1.497
ar.L2 0.7027 0.369 1.905 0.057 -0.020 1.426
ar.L3 -0.8425 0.184 -4.570 0.000 -1.204 -0.481
ma.L1 0.7227 0.280 2.578 0.010 0.173 1.272
sigma2 4.939e-05 8.15e-06 6.060 0.000 3.34e-05 6.54e-05
Ljung-Box (L1) (Q): 0.53 Jarque-Bera (JB): 8.88
Prob(Q): 0.47 Prob(JB): 0.01
Heteroskedasticity (H): 0.09 Skew: -0.38
Prob(H) (two-sided): 0.00 Kurtosis: 4.79


Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Code
# Calculate the train RMSE
train_rmse = sqrt(mean_squared_error(train_ar, fitted_model_ar1.fittedvalues))
print('The Train RMSE is {}'.format(round(rmse, 2)))

# Make predictions on the test set
predictions = fitted_model_ar1.predict(start=len(train_ar), end=len(train_ar) + len(test_ar) - 1, dynamic=False)
# Calculate the test RMSE
test_rmse = sqrt(mean_squared_error(test_ar, predictions))
print('The Test RMSE is {}'.format(round(test_rmse, 2)))
The Train RMSE is 0.02
The Test RMSE is 0.26

To refine further, however, I wanted to look at other specifications by iterating over different p,d,q combinations based on the initial insights from the plots. Since the data have been proven not to be stationary, I wanted to explore d values greater than 0 to potentially increase model robustness and accuracy by differencing the data.

Therefore, I defined the p,d, and q parameter range to perform a grid search over the different combinations. I fit each ARIMA model to the training data, calculate the Akaike Information Criterion (AIC) for model comparison, and compute the Root Mean Square Error (RMSE) on the test data for each parameter combination to evaluate model accuracy. I then identify the best-performing model based on both the lowest AIC and test RMSE, respectively, and print the model summary.

After consulting with my teammates, they mentioned that they implemented a rolling forecast origin approach to their ARIMA model. Instead of just predicting on the test set from the beginning to the end of the indices, they implemented a rolling forecast so that the model is retrained for every new prediction in the test set. This is supposed to ensure more accurate and adaptive predictive capabilities (Brownlee, 2023). I decided to try this as well to see if I could improve my ARIMA results, and it did not. However, I included those results below. Some of my other less successful ARIMA tunings can be found in the ARIMA section of the appendix.

The best performing model I found used the parameters (2,2,6).

Normal Tuning

Code
# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ar, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Predict on the test set and calculate RMSE
        test_pred = results.predict(start=test_ar.index[0], end=test_ar.index[-1], dynamic=False)
        test_rmse = np.sqrt(mean_squared_error(test_ar, test_pred))
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ar.index[0], end=train_ar.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ar, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")
ARIMA(0, 0, 0) - AIC:-258.6894931307178
ARIMA(0, 0, 0) - Test RMSE: 0.016231580382791853
ARIMA(0, 0, 1) - AIC:-301.9648325647478
ARIMA(0, 0, 1) - Test RMSE: 0.01652305682839427
ARIMA(0, 0, 2) - AIC:-332.3286603524304
ARIMA(0, 0, 2) - Test RMSE: 0.016228768600142326
ARIMA(0, 0, 3) - AIC:-346.96615214586774
ARIMA(0, 0, 3) - Test RMSE: 0.01657035541096186
ARIMA(0, 0, 4) - AIC:-340.3505924767747
ARIMA(0, 0, 4) - Test RMSE: 0.017554695544020168
ARIMA(0, 0, 5) - AIC:-350.4855010254587
ARIMA(0, 0, 5) - Test RMSE: 0.016813806929071407
ARIMA(0, 0, 6) - AIC:-359.8727599166121
ARIMA(0, 0, 6) - Test RMSE: 0.017038274430577486
ARIMA(0, 1, 0) - AIC:-381.4434651369127
ARIMA(0, 1, 0) - Test RMSE: 0.0031687058868933755
ARIMA(0, 1, 1) - AIC:-382.83122821328925
ARIMA(0, 1, 1) - Test RMSE: 0.003025470831723529
ARIMA(0, 1, 2) - AIC:-380.89980753103913
ARIMA(0, 1, 2) - Test RMSE: 0.0030126858818383274
ARIMA(0, 1, 3) - AIC:-378.8840354623777
ARIMA(0, 1, 3) - Test RMSE: 0.002974617496886501
ARIMA(0, 1, 4) - AIC:-383.3928290394596
ARIMA(0, 1, 4) - Test RMSE: 0.0026724063440836045
ARIMA(0, 1, 5) - AIC:-385.8425627458361
ARIMA(0, 1, 5) - Test RMSE: 0.0032796308097983755
ARIMA(0, 1, 6) - AIC:-383.5540988640937
ARIMA(0, 1, 6) - Test RMSE: 0.0034995251058693414
ARIMA(0, 2, 0) - AIC:-324.94669135018165
ARIMA(0, 2, 0) - Test RMSE: 0.014539793056858551
ARIMA(0, 2, 1) - AIC:-369.09571160476196
ARIMA(0, 2, 1) - Test RMSE: 0.008447511890252396
ARIMA(0, 2, 2) - AIC:-373.4354963539401
ARIMA(0, 2, 2) - Test RMSE: 0.002989243628726924
ARIMA(0, 2, 3) - AIC:-371.2126269257565
ARIMA(0, 2, 3) - Test RMSE: 0.005029160290861844
ARIMA(0, 2, 4) - AIC:-368.11404217416134
ARIMA(0, 2, 4) - Test RMSE: 0.001959801318971297
ARIMA(0, 2, 5) - AIC:-374.53673560820243
ARIMA(0, 2, 5) - Test RMSE: 0.008746503436501612
ARIMA(0, 2, 6) - AIC:-373.15034315679895
ARIMA(0, 2, 6) - Test RMSE: 0.008440896617440146
ARIMA(1, 0, 0) - AIC:-382.3215764763175
ARIMA(1, 0, 0) - Test RMSE: 0.011043864468612243
ARIMA(1, 0, 1) - AIC:-383.30776953763706
ARIMA(1, 0, 1) - Test RMSE: 0.008077000132884721
ARIMA(1, 0, 2) - AIC:-380.5715722715962
ARIMA(1, 0, 2) - Test RMSE: 0.012307402555356152
ARIMA(1, 0, 3) - AIC:-378.6949781583068
ARIMA(1, 0, 3) - Test RMSE: 0.011800189701537065
ARIMA(1, 0, 4) - AIC:-386.28134102244934
ARIMA(1, 0, 4) - Test RMSE: 0.012533681240310686
ARIMA(1, 0, 5) - AIC:-381.5308927500102
ARIMA(1, 0, 5) - Test RMSE: 0.019910035232049227
ARIMA(1, 0, 6) - AIC:-370.4643316702692
ARIMA(1, 0, 6) - Test RMSE: 0.01645939427018593
ARIMA(1, 1, 0) - AIC:-382.87766707697335
ARIMA(1, 1, 0) - Test RMSE: 0.003013809097623606
ARIMA(1, 1, 1) - AIC:-380.87007478766935
ARIMA(1, 1, 1) - Test RMSE: 0.003023464019498368
ARIMA(1, 1, 2) - AIC:-375.7913464355528
ARIMA(1, 1, 2) - Test RMSE: 0.009537611638063038
ARIMA(1, 1, 3) - AIC:-384.11405341996397
ARIMA(1, 1, 3) - Test RMSE: 0.002593387713932177
ARIMA(1, 1, 4) - AIC:-384.4680148213786
ARIMA(1, 1, 4) - Test RMSE: 0.002533585978690739
ARIMA(1, 1, 5) - AIC:-386.15314607289747
ARIMA(1, 1, 5) - Test RMSE: 0.0026779176237812807
ARIMA(1, 1, 6) - AIC:-383.40941925041454
ARIMA(1, 1, 6) - Test RMSE: 0.00329695043948469
ARIMA(1, 2, 0) - AIC:-348.00227329905454
ARIMA(1, 2, 0) - Test RMSE: 0.006660657610845069
ARIMA(1, 2, 1) - AIC:-370.4177312883888
ARIMA(1, 2, 1) - Test RMSE: 0.0036571731717321447
ARIMA(1, 2, 2) - AIC:-368.6291778055545
ARIMA(1, 2, 2) - Test RMSE: 0.0028098771434100214
ARIMA(1, 2, 3) - AIC:-369.65784691299825
ARIMA(1, 2, 3) - Test RMSE: 0.0034612193710916858
ARIMA(1, 2, 4) - AIC:-368.1700228747261
ARIMA(1, 2, 4) - Test RMSE: 0.003975401362123965
ARIMA(1, 2, 5) - AIC:-366.1983540381382
ARIMA(1, 2, 5) - Test RMSE: 0.004349452783103878
ARIMA(1, 2, 6) - AIC:-369.2041015565323
ARIMA(1, 2, 6) - Test RMSE: 0.010014744611769844
ARIMA(2, 0, 0) - AIC:-383.4023542267523
ARIMA(2, 0, 0) - Test RMSE: 0.008479128726739565
ARIMA(2, 0, 1) - AIC:-381.33427915365536
ARIMA(2, 0, 1) - Test RMSE: 0.0090820006088974
ARIMA(2, 0, 2) - AIC:-379.93864035046613
ARIMA(2, 0, 2) - Test RMSE: 0.008022598749825123
ARIMA(2, 0, 3) - AIC:-366.00922024010765
ARIMA(2, 0, 3) - Test RMSE: 0.015734002562706188
ARIMA(2, 0, 4) - AIC:-385.0698022632559
ARIMA(2, 0, 4) - Test RMSE: 0.004744984149948397
ARIMA(2, 0, 5) - AIC:-380.41668214551794
ARIMA(2, 0, 5) - Test RMSE: 0.010837638573012476
ARIMA(2, 0, 6) - AIC:-385.7856652063928
ARIMA(2, 0, 6) - Test RMSE: 0.014169724789035254
ARIMA(2, 1, 0) - AIC:-380.890186289345
ARIMA(2, 1, 0) - Test RMSE: 0.0030132147296201505
ARIMA(2, 1, 1) - AIC:-378.9095114290313
ARIMA(2, 1, 1) - Test RMSE: 0.003013314726259067
ARIMA(2, 1, 2) - AIC:-376.91122793143654
ARIMA(2, 1, 2) - Test RMSE: 0.0030137866198045667
ARIMA(2, 1, 3) - AIC:-378.6505874076062
ARIMA(2, 1, 3) - Test RMSE: 0.0029714358047343817
ARIMA(2, 1, 4) - AIC:-378.9874675391219
ARIMA(2, 1, 4) - Test RMSE: 0.0029999807968734936
ARIMA(2, 1, 5) - AIC:-382.29660446133914
ARIMA(2, 1, 5) - Test RMSE: 0.0028520727797484314
ARIMA(2, 1, 6) - AIC:-383.06265244574126
ARIMA(2, 1, 6) - Test RMSE: 0.0029117794198380872
ARIMA(2, 2, 0) - AIC:-352.69505213204354
ARIMA(2, 2, 0) - Test RMSE: 0.0033819366094535257
ARIMA(2, 2, 1) - AIC:-370.382007290586
ARIMA(2, 2, 1) - Test RMSE: 0.0027931087689379726
ARIMA(2, 2, 2) - AIC:-367.8349349937622
ARIMA(2, 2, 2) - Test RMSE: 0.010329269131930933
ARIMA(2, 2, 3) - AIC:-364.1550294373634
ARIMA(2, 2, 3) - Test RMSE: 0.0030915953308923933
ARIMA(2, 2, 4) - AIC:-366.1535721238879
ARIMA(2, 2, 4) - Test RMSE: 0.003954069103975002
ARIMA(2, 2, 5) - AIC:-364.2684681108542
ARIMA(2, 2, 5) - Test RMSE: 0.004446995841283961
ARIMA(2, 2, 6) - AIC:-363.30886315195175
ARIMA(2, 2, 6) - Test RMSE: 0.0016051827138580381
ARIMA(1, 0, 4) with lowest AIC of -386.28134102244934
ARIMA(2, 2, 6) with lowest test RMSE of 0.0016051827138580381
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   55
Model:                       ARIMA(1, 0, 4)   Log Likelihood                 200.141
Date:                      Thu, 23 Nov 2023   AIC                           -386.281
Time:                              21:48:42   BIC                           -372.230
Sample:                          11-10-2021   HQIC                          -380.848
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const          0.0270      0.016      1.657      0.098      -0.005       0.059
ar.L1          0.9521      0.041     23.271      0.000       0.872       1.032
ma.L1         -0.4529      0.132     -3.430      0.001      -0.712      -0.194
ma.L2         -0.0489      0.161     -0.304      0.761      -0.364       0.266
ma.L3          0.0594      0.153      0.389      0.697      -0.240       0.358
ma.L4          0.4803      0.184      2.615      0.009       0.120       0.840
sigma2      3.341e-05   5.84e-06      5.723      0.000     2.2e-05    4.49e-05
===================================================================================
Ljung-Box (L1) (Q):                   0.20   Jarque-Bera (JB):                14.85
Prob(Q):                              0.66   Prob(JB):                         0.00
Heteroskedasticity (H):               0.08   Skew:                             0.17
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.52
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(2, 2, 6) - Train RMSE: 0.012904220149601586
Best ARIMA(2, 2, 6) - Test RMSE: 0.0016051827138580381
Code
# Define the ARIMA order
arima_order226 = (2, 2, 6)

# Fit the ARIMA model
model226 = ARIMA(train_ar, order=arima_order226)
fitted_model226 = model226.fit()

# Predict on the training set
train_pred_ar226 = fitted_model226.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar226 = fitted_model226.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar226 = np.sqrt(mean_squared_error(train_ar, train_pred_ar226))
test_rmse_ar226 = np.sqrt(mean_squared_error(test_ar, test_pred_ar226))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar226}")
print(f"Test RMSE: {test_rmse_ar226}")

# Model summary
fitted_model226.summary()
Train RMSE: 0.012904220149601586
Test RMSE: 0.0016051827138580381
SARIMAX Results
Dep. Variable: Additional_Doses_Vax_Pct No. Observations: 55
Model: ARIMA(2, 2, 6) Log Likelihood 190.654
Date: Thu, 23 Nov 2023 AIC -363.309
Time: 21:49:15 BIC -345.576
Sample: 11-10-2021 HQIC -356.490
- 11-23-2022
Covariance Type: opg
coef std err z P>|z| [0.025 0.975]
ar.L1 -0.9139 0.545 -1.676 0.094 -1.983 0.155
ar.L2 -0.8167 0.506 -1.613 0.107 -1.809 0.176
ma.L1 -0.5406 0.579 -0.934 0.350 -1.674 0.593
ma.L2 -0.0184 0.783 -0.023 0.981 -1.553 1.516
ma.L3 -0.6424 0.923 -0.696 0.487 -2.452 1.167
ma.L4 0.4587 0.412 1.114 0.265 -0.348 1.266
ma.L5 0.1187 0.232 0.512 0.609 -0.335 0.573
ma.L6 -0.2258 0.257 -0.878 0.380 -0.730 0.278
sigma2 4.083e-05 1.44e-05 2.838 0.005 1.26e-05 6.9e-05
Ljung-Box (L1) (Q): 0.82 Jarque-Bera (JB): 16.00
Prob(Q): 0.37 Prob(JB): 0.00
Heteroskedasticity (H): 0.03 Skew: 0.06
Prob(H) (two-sided): 0.00 Kurtosis: 5.69


Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

Rolling Forecast Tuning

Code
# Rolling forecast origin evaluation function
def rolling_forecast_origin(train_data, test_data, arima_order):
    history = [x for x in train_data]
    predictions = []
    for t in range(len(test_data)):
        model = ARIMA(history, order=arima_order)
        model_fit = model.fit()
        yhat = model_fit.forecast()[0]
        predictions.append(yhat)
        history.append(test_data[t])
    error = mean_squared_error(test_data, predictions)
    return np.sqrt(error)

# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ar, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Use the rolling forecast origin approach for RMSE calculation
        test_rmse = rolling_forecast_origin(train_ar.values, test_ar.values, param)
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ar.index[0], end=train_ar.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ar, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")
ARIMA(0, 0, 0) - AIC:-258.6894931307178
ARIMA(0, 0, 0) - Test RMSE: 0.013655896062874404
ARIMA(0, 0, 1) - AIC:-301.9648325647478
ARIMA(0, 0, 1) - Test RMSE: 0.008083540954699313
ARIMA(0, 0, 2) - AIC:-332.3286603524304
ARIMA(0, 0, 2) - Test RMSE: 0.005280807332437404
ARIMA(0, 0, 3) - AIC:-346.96615214586774
ARIMA(0, 0, 3) - Test RMSE: 0.004239222155210245
ARIMA(0, 0, 4) - AIC:-340.3505924767747
ARIMA(0, 0, 4) - Test RMSE: 0.003594097104956877
ARIMA(0, 0, 5) - AIC:-350.4855010254587
ARIMA(0, 0, 5) - Test RMSE: 0.003762480775669052
ARIMA(0, 0, 6) - AIC:-359.8727599166121
ARIMA(0, 0, 6) - Test RMSE: 0.0037613201003855955
ARIMA(0, 1, 0) - AIC:-381.4434651369127
ARIMA(0, 1, 0) - Test RMSE: 0.0007879153555493013
ARIMA(0, 1, 1) - AIC:-382.83122821328925
ARIMA(0, 1, 1) - Test RMSE: 0.0007346779405401142
ARIMA(0, 1, 2) - AIC:-380.89980753103913
ARIMA(0, 1, 2) - Test RMSE: 0.0007351207558801304
ARIMA(0, 1, 3) - AIC:-378.8840354623777
ARIMA(0, 1, 3) - Test RMSE: 0.0007255123034331112
ARIMA(0, 1, 4) - AIC:-383.3928290394596
ARIMA(0, 1, 4) - Test RMSE: 0.001283501096894188
ARIMA(0, 1, 5) - AIC:-385.8425627458361
ARIMA(0, 1, 5) - Test RMSE: 0.0011041657167933626
ARIMA(0, 1, 6) - AIC:-383.5540988640937
ARIMA(0, 1, 6) - Test RMSE: 0.001053669388962815
ARIMA(0, 2, 0) - AIC:-324.94669135018165
ARIMA(0, 2, 0) - Test RMSE: 0.0013137128328188084
ARIMA(0, 2, 1) - AIC:-369.09571160476196
ARIMA(0, 2, 1) - Test RMSE: 0.0009230734522866896
ARIMA(0, 2, 2) - AIC:-373.4354963539401
ARIMA(0, 2, 2) - Test RMSE: 0.000716934726620152
ARIMA(0, 2, 3) - AIC:-371.2126269257565
ARIMA(0, 2, 3) - Test RMSE: 0.0007657060390638473
ARIMA(0, 2, 4) - AIC:-368.11404217416134
ARIMA(0, 2, 4) - Test RMSE: 0.0007972211596679746
ARIMA(0, 2, 5) - AIC:-374.53673560820243
ARIMA(0, 2, 5) - Test RMSE: 0.0012629510105841486
ARIMA(0, 2, 6) - AIC:-373.15034315679895
ARIMA(0, 2, 6) - Test RMSE: 0.001463951609386889
ARIMA(1, 0, 0) - AIC:-382.3215764763175
ARIMA(1, 0, 0) - Test RMSE: 0.0011001518602945474
ARIMA(1, 0, 1) - AIC:-383.30776953763706
ARIMA(1, 0, 1) - Test RMSE: 0.0011414569579487272
ARIMA(1, 0, 2) - AIC:-380.5715722715962
ARIMA(1, 0, 2) - Test RMSE: 0.0011624374011564651
ARIMA(1, 0, 3) - AIC:-378.6949781583068
ARIMA(1, 0, 3) - Test RMSE: 0.001376727835460381
ARIMA(1, 0, 4) - AIC:-386.28134102244934
ARIMA(1, 0, 4) - Test RMSE: 0.0016009908940691044
ARIMA(1, 0, 5) - AIC:-381.5308927500102
ARIMA(1, 0, 5) - Test RMSE: 0.0020207127174322924
ARIMA(1, 0, 6) - AIC:-370.4643316702692
ARIMA(1, 0, 6) - Test RMSE: 0.0027809121728125
ARIMA(1, 1, 0) - AIC:-382.87766707697335
ARIMA(1, 1, 0) - Test RMSE: 0.0007381663933386366
ARIMA(1, 1, 1) - AIC:-380.87007478766935
ARIMA(1, 1, 1) - Test RMSE: 0.0007353872810035192
ARIMA(1, 1, 2) - AIC:-375.7913464355528
ARIMA(1, 1, 2) - Test RMSE: 0.0011289016158743696
ARIMA(1, 1, 3) - AIC:-384.11405341996397
ARIMA(1, 1, 3) - Test RMSE: 0.0009867673305485702
ARIMA(1, 1, 4) - AIC:-384.4680148213786
ARIMA(1, 1, 4) - Test RMSE: 0.00111478107671361
ARIMA(1, 1, 5) - AIC:-386.15314607289747
ARIMA(1, 1, 5) - Test RMSE: 0.0011037222849230011
ARIMA(1, 1, 6) - AIC:-383.40941925041454
ARIMA(1, 1, 6) - Test RMSE: 0.0011882081105095757
ARIMA(1, 2, 0) - AIC:-348.00227329905454
ARIMA(1, 2, 0) - Test RMSE: 0.0010350130711326343
ARIMA(1, 2, 1) - AIC:-370.4177312883888
ARIMA(1, 2, 1) - Test RMSE: 0.0007863368733989633
ARIMA(1, 2, 2) - AIC:-368.6291778055545
ARIMA(1, 2, 2) - Test RMSE: 0.0007574715964517772
ARIMA(1, 2, 3) - AIC:-369.65784691299825
ARIMA(1, 2, 3) - Test RMSE: 0.0007325021413680174
ARIMA(1, 2, 4) - AIC:-368.1700228747261
ARIMA(1, 2, 4) - Test RMSE: 0.000779244025179258
ARIMA(1, 2, 5) - AIC:-366.1983540381382
ARIMA(1, 2, 5) - Test RMSE: 0.0007535267826870733
ARIMA(1, 2, 6) - AIC:-369.2041015565323
ARIMA(1, 2, 6) - Test RMSE: 0.0012355316458458406
ARIMA(2, 0, 0) - AIC:-383.4023542267523
ARIMA(2, 0, 0) - Test RMSE: 0.0009762524944619472
ARIMA(2, 0, 1) - AIC:-381.33427915365536
ARIMA(2, 0, 1) - Test RMSE: 0.001029930633790193
ARIMA(2, 0, 2) - AIC:-379.93864035046613
ARIMA(2, 0, 2) - Test RMSE: 0.0009567830177354126
ARIMA(2, 0, 3) - AIC:-366.00922024010765
ARIMA(2, 0, 3) - Test RMSE: 0.0013441112737286388
ARIMA(2, 0, 4) - AIC:-385.0698022632559
ARIMA(2, 0, 4) - Test RMSE: 0.0011077374611606853
ARIMA(2, 0, 5) - AIC:-380.41668214551794
ARIMA(2, 0, 5) - Test RMSE: 0.0013950716835243258
ARIMA(2, 0, 6) - AIC:-385.7856652063928
ARIMA(2, 0, 6) - Test RMSE: 0.001184792123323465
ARIMA(2, 1, 0) - AIC:-380.890186289345
ARIMA(2, 1, 0) - Test RMSE: 0.0007360773082381593
ARIMA(2, 1, 1) - AIC:-378.9095114290313
ARIMA(2, 1, 1) - Test RMSE: 0.0007354342819157653
ARIMA(2, 1, 2) - AIC:-376.91122793143654
ARIMA(2, 1, 2) - Test RMSE: 0.0007352924486424919
ARIMA(2, 1, 3) - AIC:-378.6505874076062
ARIMA(2, 1, 3) - Test RMSE: 0.0007042901080159054
ARIMA(2, 1, 4) - AIC:-378.9874675391219
ARIMA(2, 1, 4) - Test RMSE: 0.0007510430924660067
ARIMA(2, 1, 5) - AIC:-382.29660446133914
ARIMA(2, 1, 5) - Test RMSE: 0.0009300998699585952
ARIMA(2, 1, 6) - AIC:-383.06265244574126
ARIMA(2, 1, 6) - Test RMSE: 0.001144367236202181
ARIMA(2, 2, 0) - AIC:-352.69505213204354
ARIMA(2, 2, 0) - Test RMSE: 0.0009032824087002225
ARIMA(2, 2, 1) - AIC:-370.382007290586
ARIMA(2, 2, 1) - Test RMSE: 0.0006968667668850116
ARIMA(2, 2, 2) - AIC:-367.8349349937622
ARIMA(2, 2, 2) - Test RMSE: 0.0009211618291784967
ARIMA(2, 2, 3) - AIC:-364.1550294373634
ARIMA(2, 2, 3) - Test RMSE: 0.0007319836725066403
ARIMA(2, 2, 4) - AIC:-366.1535721238879
ARIMA(2, 2, 4) - Test RMSE: 0.0007628825381315536
ARIMA(2, 2, 5) - AIC:-364.2684681108542
ARIMA(2, 2, 5) - Test RMSE: 0.0007286535916222551
ARIMA(2, 2, 6) - AIC:-363.30886315195175
ARIMA(2, 2, 6) - Test RMSE: 0.0008412344827507514
ARIMA(1, 0, 4) with lowest AIC of -386.28134102244934
ARIMA(2, 2, 1) with lowest test RMSE of 0.0006968667668850116
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   55
Model:                       ARIMA(1, 0, 4)   Log Likelihood                 200.141
Date:                      Thu, 23 Nov 2023   AIC                           -386.281
Time:                              21:44:30   BIC                           -372.230
Sample:                          11-10-2021   HQIC                          -380.848
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const          0.0270      0.016      1.657      0.098      -0.005       0.059
ar.L1          0.9521      0.041     23.271      0.000       0.872       1.032
ma.L1         -0.4529      0.132     -3.430      0.001      -0.712      -0.194
ma.L2         -0.0489      0.161     -0.304      0.761      -0.364       0.266
ma.L3          0.0594      0.153      0.389      0.697      -0.240       0.358
ma.L4          0.4803      0.184      2.615      0.009       0.120       0.840
sigma2      3.341e-05   5.84e-06      5.723      0.000     2.2e-05    4.49e-05
===================================================================================
Ljung-Box (L1) (Q):                   0.20   Jarque-Bera (JB):                14.85
Prob(Q):                              0.66   Prob(JB):                         0.00
Heteroskedasticity (H):               0.08   Skew:                             0.17
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.52
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(2, 2, 1) - Train RMSE: 0.012914146744532878
Best ARIMA(2, 2, 1) - Test RMSE: 0.0006968667668850116
Code
# Define the ARIMA order
arima_order221 = (2, 2, 1)

# Fit the ARIMA model
model221 = ARIMA(train_ar, order=arima_order221)
fitted_model221 = model221.fit()

# Predict on the training set
train_pred_ar221 = fitted_model221.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar221 = fitted_model221.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar221 = np.sqrt(mean_squared_error(train_ar, train_pred_ar221))
test_rmse_ar221 = np.sqrt(mean_squared_error(test_ar, test_pred_ar221))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar221}")
print(f"Test RMSE: {test_rmse_ar221}")

# Model summary
fitted_model221.summary()
Train RMSE: 0.012914146744532878
Test RMSE: 0.0027931087689379726
SARIMAX Results
Dep. Variable: Additional_Doses_Vax_Pct No. Observations: 55
Model: ARIMA(2, 2, 1) Log Likelihood 189.191
Date: Thu, 23 Nov 2023 AIC -370.382
Time: 21:45:51 BIC -362.501
Sample: 11-10-2021 HQIC -367.351
- 11-23-2022
Covariance Type: opg
coef std err z P>|z| [0.025 0.975]
ar.L1 -0.4016 0.110 -3.651 0.000 -0.617 -0.186
ar.L2 -0.1478 0.170 -0.870 0.384 -0.481 0.185
ma.L1 -0.8806 0.099 -8.897 0.000 -1.075 -0.687
sigma2 4.436e-05 6.74e-06 6.584 0.000 3.12e-05 5.76e-05
Ljung-Box (L1) (Q): 0.02 Jarque-Bera (JB): 20.97
Prob(Q): 0.88 Prob(JB): 0.00
Heteroskedasticity (H): 0.01 Skew: 0.16
Prob(H) (two-sided): 0.00 Kurtosis: 6.06


Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

For models without seasonality, I achieved the best results after scaling my data and performing a loop to tune for the p,d,q values. Although there does not appear to be any seasonality in visuals I have plotted of the data, next, I experimented with seasonality to see if I could improve my model further. I trained a base model on the scaled data with the best non-seasonal parameters found in my last tuning and P = D = Q = 1. However, I was unable to achieve an RMSE lower than that without a seasonality parameter, confirming my suspicions.

Code
# Fit SARIMA model
p, d, q = 0, 1, 6  # Non-seasonal parameters
P, D, Q, s = 1, 1, 1, 13  # Seasonal parameters 

model = SARIMAX(train_ar, order=(p, d, q), seasonal_order=(P, D, Q, s))
fitted_model = model.fit()

# Predict on the training set
train_pred_scaled = fitted_model.predict(start=0, end=len(train_ar)-1)

# Predict on the test set
test_pred_scaled = fitted_model.predict(start=len(train_ar), end=len(train_ar) + len(test_ar) - 1)

# Calculate RMSE for train and test sets (on scaled data)
train_rmse_scaled = np.sqrt(mean_squared_error(train_ar, train_pred_scaled))
test_rmse_scaled = np.sqrt(mean_squared_error(test_ar, test_pred_scaled))

# Print RMSE values
print(f"Train RMSE (Seasonal): {train_rmse_scaled}")
print(f"Test RMSE (Seasonal): {test_rmse_scaled}")
RUNNING THE L-BFGS-B CODE

           * * *

Machine precision = 2.220D-16
 N =            9     M =           10

At X0         0 variables are exactly at the bounds

At iterate    0    f= -2.14905D+00    |proj g|=  1.94634D+02
 This problem is unconstrained.

At iterate    5    f= -2.38848D+00    |proj g|=  1.73747D+00

At iterate   10    f= -2.41406D+00    |proj g|=  4.85270D+01

At iterate   15    f= -2.50794D+00    |proj g|=  9.77253D+00

At iterate   20    f= -2.51362D+00    |proj g|=  1.41776D+00

At iterate   25    f= -2.56552D+00    |proj g|=  1.61759D+00

At iterate   30    f= -2.56706D+00    |proj g|=  7.60589D-01

At iterate   35    f= -2.57050D+00    |proj g|=  1.48891D+00

At iterate   40    f= -2.57469D+00    |proj g|=  4.40264D-01

At iterate   45    f= -2.59143D+00    |proj g|=  1.80789D-01

At iterate   50    f= -2.60053D+00    |proj g|=  2.63546D+00

           * * *

Tit   = total number of iterations
Tnf   = total number of function evaluations
Tnint = total number of segments explored during Cauchy searches
Skip  = number of BFGS updates skipped
Nact  = number of active bounds at final generalized Cauchy point
Projg = norm of the final projected gradient
F     = final function value

           * * *

   N    Tit     Tnf  Tnint  Skip  Nact     Projg        F
    9     50     83      1     0     0   2.635D+00  -2.601D+00
  F =  -2.6005290031011610     

STOP: TOTAL NO. of ITERATIONS REACHED LIMIT                 
Train RMSE (Seasonal): 0.014185544956048879
Test RMSE (Seasonal): 0.004037612819634297

1.3.1.3 3. Model Performance

The best parameter values I obtained were (2,2,6). This indicates a second-order autoregressive part, a second-order differencing, and a sixth-order moving average part. Below are visualizations showing how my train and test predictions for the best non-seasonal ARIMA model I created compare to the actual values. I also included the RMSEs and model summary for reference again. It is important to note how unusual it is that the test RMSE is lower than that of the train data. I believe, however, this is due to the cumulative nature of the dataset used. Since the Locations are reaching near 100% vaccination rates, the trend is much less complex in our test set. Therefore, I think this simplicity and slow increase is lending itself to a highly accurate test rate.

The log likelihood is quite high and the AIC and BIC are both very low (negative) indicating a good model fit. However, the \(P>|z|\) Values for the AR and MA terms are greater than 0.05 aside from the sigma2 term, suggesting that the coefficients for the AR and MA terms might not all be significantly different from zero but that the variance of the error term is significantly different from zero.

There might be potential over-parameterization and heteroskedastic residuals, suggesting that the model may not be appropriately capturing the underlying process. I show the results of cross validation below to further bolster my assessment.

Code
# Define the ARIMA order
arima_order226 = (2, 2, 6)

# Fit the ARIMA model
model226 = ARIMA(train_ar, order=arima_order226)
fitted_model226 = model226.fit()

# Predict on the training set
train_pred_ar226 = fitted_model226.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar226 = fitted_model226.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar226 = np.sqrt(mean_squared_error(train_ar, train_pred_ar226))
test_rmse_ar226 = np.sqrt(mean_squared_error(test_ar, test_pred_ar226))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar226}")
print(f"Test RMSE: {test_rmse_ar226}")

# Plotting
plt.figure(figsize=(15, 6))

# Train Data Plot
plt.subplot(1, 2, 1)
plt.plot(train_ar, label='Actual')
plt.plot(train_pred_ar226, label='Predicted')
plt.title('Train Data: Actual vs Predicted')
plt.xlabel('Time')
plt.ylabel('Vaccination Percentage')
plt.legend()

# Test Data Plot
plt.subplot(1, 2, 2)
plt.plot(test_ar, label='Actual')
plt.plot(test_pred_ar226, label='Predicted')
plt.title('Test Data: Actual vs Predicted')
plt.xlabel('Time')
plt.ylabel('Vaccination Percentage')
plt.legend()

plt.tight_layout()
plt.show()
Train RMSE: 0.012904220149601586
Test RMSE: 0.0016051827138580381

Code
# Model summary
fitted_model226.summary()
SARIMAX Results
Dep. Variable: Additional_Doses_Vax_Pct No. Observations: 55
Model: ARIMA(2, 2, 6) Log Likelihood 190.654
Date: Fri, 24 Nov 2023 AIC -363.309
Time: 16:09:04 BIC -345.576
Sample: 11-10-2021 HQIC -356.490
- 11-23-2022
Covariance Type: opg
coef std err z P>|z| [0.025 0.975]
ar.L1 -0.9139 0.545 -1.676 0.094 -1.983 0.155
ar.L2 -0.8167 0.506 -1.613 0.107 -1.809 0.176
ma.L1 -0.5406 0.579 -0.934 0.350 -1.674 0.593
ma.L2 -0.0184 0.783 -0.023 0.981 -1.553 1.516
ma.L3 -0.6424 0.923 -0.696 0.487 -2.452 1.167
ma.L4 0.4587 0.412 1.114 0.265 -0.348 1.266
ma.L5 0.1187 0.232 0.512 0.609 -0.335 0.573
ma.L6 -0.2258 0.257 -0.878 0.380 -0.730 0.278
sigma2 4.083e-05 1.44e-05 2.838 0.005 1.26e-05 6.9e-05
Ljung-Box (L1) (Q): 0.82 Jarque-Bera (JB): 16.00
Prob(Q): 0.37 Prob(JB): 0.00
Heteroskedasticity (H): 0.03 Skew: 0.06
Prob(H) (two-sided): 0.00 Kurtosis: 5.69


Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Code
# Function to perform ADF test
def adf_test(series, alpha=0.05):
    result = adfuller(series, autolag='AIC')
    if result[1] < alpha:
        return True  # Stationary
    else:
        return False  # Non-stationary

# Check stationarity and apply differencing if needed
if not adf_test(train_ar):
    d = 1
    train_ar = train_ar.diff().dropna()
else:
    d = 0

# Use time-series cross-validation to assess potential models
tscv = TimeSeriesSplit(n_splits=3)
for param in pdq:
    temp_model_scores = []
    for train_index, val_index in tscv.split(train_ar):
        cv_train, cv_val = train_ar.iloc[train_index], train_ar.iloc[val_index]
        try:
            temp_model = ARIMA(cv_train, order=(param[0], d, param[2]))
            temp_results = temp_model.fit()
            val_pred = temp_results.predict(start=cv_val.index[0], end=cv_val.index[-1], dynamic=False)
            val_rmse = np.sqrt(mean_squared_error(cv_val, val_pred))
            temp_model_scores.append(val_rmse)
        except Exception as e:
            print(f'Error fitting ARIMA{param}: {e}')
            continue
    avg_rmse = np.mean(temp_model_scores)
    rmse_scores.append((param, avg_rmse))
    print(f'ARIMA{param} - Average Validation RMSE: {avg_rmse}')

# Find the parameters with the best average RMSE from cross-validation
best_rmse_model = min(rmse_scores, key=lambda x: x[1])
print(f"Best ARIMA{best_rmse_model[0]} - Average Validation RMSE: {best_rmse_model[1]}")

# Fit the best model on the entire training set
best_model = ARIMA(train_ar, order=(best_rmse_model[0][0], d, best_rmse_model[0][2]))
best_model_fit = best_model.fit()
ARIMA(0, 0, 0) - Average Validation RMSE: 0.004364790900593163
ARIMA(0, 0, 1) - Average Validation RMSE: 0.004561401086084078
ARIMA(0, 0, 2) - Average Validation RMSE: 0.0048324322820273635
ARIMA(0, 0, 3) - Average Validation RMSE: 0.004076207243297506
ARIMA(0, 0, 4) - Average Validation RMSE: 0.005893881201934175
ARIMA(0, 0, 5) - Average Validation RMSE: 0.0054462361401931905
ARIMA(0, 0, 6) - Average Validation RMSE: 0.004851147131314997
ARIMA(0, 1, 0) - Average Validation RMSE: 0.004364790900593163
ARIMA(0, 1, 1) - Average Validation RMSE: 0.004561401086084078
ARIMA(0, 1, 2) - Average Validation RMSE: 0.0048324322820273635
ARIMA(0, 1, 3) - Average Validation RMSE: 0.004076207243297506
ARIMA(0, 1, 4) - Average Validation RMSE: 0.005893881201934175
ARIMA(0, 1, 5) - Average Validation RMSE: 0.0054462361401931905
ARIMA(0, 1, 6) - Average Validation RMSE: 0.004851147131314997
ARIMA(0, 2, 0) - Average Validation RMSE: 0.004364790900593163
ARIMA(0, 2, 1) - Average Validation RMSE: 0.004561401086084078
ARIMA(0, 2, 2) - Average Validation RMSE: 0.0048324322820273635
ARIMA(0, 2, 3) - Average Validation RMSE: 0.004076207243297506
ARIMA(0, 2, 4) - Average Validation RMSE: 0.005893881201934175
ARIMA(0, 2, 5) - Average Validation RMSE: 0.0054462361401931905
ARIMA(0, 2, 6) - Average Validation RMSE: 0.004851147131314997
ARIMA(1, 0, 0) - Average Validation RMSE: 0.004361648698327819
ARIMA(1, 0, 1) - Average Validation RMSE: 0.004409976923259427
ARIMA(1, 0, 2) - Average Validation RMSE: 0.004442167220841902
ARIMA(1, 0, 3) - Average Validation RMSE: 0.00529719807945231
ARIMA(1, 0, 4) - Average Validation RMSE: 0.005411522771384412
ARIMA(1, 0, 5) - Average Validation RMSE: 0.005879241239000709
ARIMA(1, 0, 6) - Average Validation RMSE: 0.005444840840618367
ARIMA(1, 1, 0) - Average Validation RMSE: 0.004361648698327819
ARIMA(1, 1, 1) - Average Validation RMSE: 0.004409976923259427
ARIMA(1, 1, 2) - Average Validation RMSE: 0.004442167220841902
ARIMA(1, 1, 3) - Average Validation RMSE: 0.00529719807945231
ARIMA(1, 1, 4) - Average Validation RMSE: 0.005411522771384412
ARIMA(1, 1, 5) - Average Validation RMSE: 0.005879241239000709
ARIMA(1, 1, 6) - Average Validation RMSE: 0.005444840840618367
ARIMA(1, 2, 0) - Average Validation RMSE: 0.004361648698327819
ARIMA(1, 2, 1) - Average Validation RMSE: 0.004409976923259427
ARIMA(1, 2, 2) - Average Validation RMSE: 0.004442167220841902
ARIMA(1, 2, 3) - Average Validation RMSE: 0.00529719807945231
ARIMA(1, 2, 4) - Average Validation RMSE: 0.005411522771384412
ARIMA(1, 2, 5) - Average Validation RMSE: 0.005879241239000709
ARIMA(1, 2, 6) - Average Validation RMSE: 0.005444840840618367
ARIMA(2, 0, 0) - Average Validation RMSE: 0.0044052824464112465
ARIMA(2, 0, 1) - Average Validation RMSE: 0.004286574776345281
ARIMA(2, 0, 2) - Average Validation RMSE: 0.005433699663540851
ARIMA(2, 0, 3) - Average Validation RMSE: 0.004230333064103697
ARIMA(2, 0, 4) - Average Validation RMSE: 0.00524945636745735
ARIMA(2, 0, 5) - Average Validation RMSE: 0.005781178937299961
ARIMA(2, 0, 6) - Average Validation RMSE: 0.005935648933608896
ARIMA(2, 1, 0) - Average Validation RMSE: 0.0044052824464112465
ARIMA(2, 1, 1) - Average Validation RMSE: 0.004286574776345281
ARIMA(2, 1, 2) - Average Validation RMSE: 0.005433699663540851
ARIMA(2, 1, 3) - Average Validation RMSE: 0.004230333064103697
ARIMA(2, 1, 4) - Average Validation RMSE: 0.00524945636745735
ARIMA(2, 1, 5) - Average Validation RMSE: 0.005781178937299961
ARIMA(2, 1, 6) - Average Validation RMSE: 0.005935648933608896
ARIMA(2, 2, 0) - Average Validation RMSE: 0.0044052824464112465
ARIMA(2, 2, 1) - Average Validation RMSE: 0.004286574776345281
ARIMA(2, 2, 2) - Average Validation RMSE: 0.005433699663540851
ARIMA(2, 2, 3) - Average Validation RMSE: 0.004230333064103697
ARIMA(2, 2, 4) - Average Validation RMSE: 0.00524945636745735
ARIMA(2, 2, 5) - Average Validation RMSE: 0.005781178937299961
ARIMA(2, 2, 6) - Average Validation RMSE: 0.005935648933608896
Best ARIMA(2, 2, 6) - Average Validation RMSE: 0.0016051827138580381

1.3.2 B. auto_arima Model

1.3.2.1 1. Data Preparation:

The data preparation for auto_arima is identical to that of ARIMA as I simply only select the Date column and response variable, group the data by observation Date, and then do a 70-30 train-test split. I also scaled the data for comparison with the other models and because of its succcess in other models. While I considered differencing the data myself, I decided that it was unecessary since the d parameter in the auto_arima takes care of this. I worried that if I manually differenced the data before passing it to auto_arima it could lead to over-differencing, where the time series becomes too “flat,” losing valuable information.

Code
# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Import data with specific columns
df = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime and group by 'Date'
df['Date'] = pd.to_datetime(df['Date'])
df = df.groupby('Date')[pred_var].mean()

# Sorting the DataFrame by the index
df.sort_index(inplace=True)

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_scaled = pd.DataFrame(scaler.fit_transform(df.values.reshape(-1, 1)), index=df.index, columns=[pred_var])

# Calculate the index for the 70-30 split
split_index = int(len(df_scaled) * 0.7)

# Split into scaled and differenced train and test sets
train_aar = df_scaled_diff.iloc[:split_index]
test_aar = df_scaled_diff.iloc[split_index:]

Some of auto_arima’s key parameters are as follows:

start_p, start_q, max_p, max_q: The starting and maximum values of the AR (p) and MA (q) terms.

d: The order of first-differencing. If None, it is determined automatically through tests such as ADF.

start_P, start_Q, max_P, max_Q: The starting and maximum values for the seasonal part of the model.

D: The order of seasonal differencing. If None, it will be determined through the seasonal_test.

seasonal: Condition to fit a seasonal ARIMA.

m: The number of periods per season.

stepwise: Applies the stepwise algorithm.

information_criterion: Metric used for model selection.

max_order: Maximum value of p+q+P+Q to suppress overcomplexity.

out_of_sample_size: The number of samples to use for out-of-bag (OOB) statistics ((Smith et al., 2017).

The difference between ARIMA and auto_arima is that the latter iteratively and automatically determines the best parameters for the model. ARIMA, in comparison, must be manually tuned.

1.3.2.2 2. Model Building

Below I run auto_arima to find the optimal SARIMA model parameters. Based on the information I gained from developing the ARIMA model, I decided to define the range of the p, and q parameters as between 0 and 7, d=1, and, after trying a few different numbers, I set m = 24 because that gave me the best result. Finally, I set stepwise = False because I wanted to do a comprehensive search. If it was set to True it might miss the optimal parameters if they are located far from the starting point in the parameter space as stepwise = True employs a more efficient approach by looking at neighboring models to the iteratively best one. Although it did not help in my previous ARIMA models, for some reason setting seasonality = True greatly improves my test RMSE.

I tried some other variations of the model changing parameters such as m. However, the approach I took below gave me the most successful results. The other models can be found in the Other auto_arima Models section of the appendix.

Code
# Run auto_arima to find optimal SARIMA model parameters
model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=24,
                        start_P=0, seasonal=True,
                        d=2, D = 1, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

print(model.summary())
print(f"AIC: {model.aic()}")
 ARIMA(0,2,0)(0,1,0)[24]             : AIC=-166.041, Time=0.10 sec
 ARIMA(0,2,0)(0,1,1)[24]             : AIC=-164.041, Time=0.53 sec
 ARIMA(0,2,0)(0,1,2)[24]             : AIC=-162.041, Time=1.70 sec
 ARIMA(0,2,0)(1,1,0)[24]             : AIC=-164.053, Time=0.61 sec
 ARIMA(0,2,0)(1,1,1)[24]             : AIC=-162.041, Time=0.88 sec
 ARIMA(0,2,0)(1,1,2)[24]             : AIC=-160.041, Time=3.45 sec
 ARIMA(0,2,0)(2,1,0)[24]             : AIC=-162.041, Time=0.95 sec
 ARIMA(0,2,0)(2,1,1)[24]             : AIC=-160.041, Time=2.36 sec
 ARIMA(0,2,0)(2,1,2)[24]             : AIC=-158.041, Time=2.01 sec
 ARIMA(0,2,1)(0,1,0)[24]             : AIC=-186.906, Time=0.07 sec
 ARIMA(0,2,1)(0,1,1)[24]             : AIC=-184.906, Time=0.35 sec
 ARIMA(0,2,1)(0,1,2)[24]             : AIC=-182.906, Time=1.86 sec
 ARIMA(0,2,1)(1,1,0)[24]             : AIC=-184.925, Time=0.88 sec
 ARIMA(0,2,1)(1,1,1)[24]             : AIC=-184.796, Time=1.33 sec
 ARIMA(0,2,1)(1,1,2)[24]             : AIC=-180.906, Time=1.87 sec
 ARIMA(0,2,1)(2,1,0)[24]             : AIC=-182.988, Time=5.07 sec
 ARIMA(0,2,1)(2,1,1)[24]             : AIC=-180.906, Time=1.84 sec
 ARIMA(0,2,1)(2,1,2)[24]             : AIC=-178.906, Time=3.36 sec
 ARIMA(0,2,2)(0,1,0)[24]             : AIC=-190.267, Time=0.26 sec
 ARIMA(0,2,2)(0,1,1)[24]             : AIC=-187.525, Time=1.70 sec
 ARIMA(0,2,2)(0,1,2)[24]             : AIC=-187.335, Time=8.52 sec
 ARIMA(0,2,2)(1,1,0)[24]             : AIC=-189.053, Time=1.22 sec
 ARIMA(0,2,2)(1,1,1)[24]             : AIC=-185.601, Time=2.02 sec
 ARIMA(0,2,2)(1,1,2)[24]             : AIC=-184.499, Time=6.58 sec
 ARIMA(0,2,2)(2,1,0)[24]             : AIC=-184.362, Time=2.74 sec
 ARIMA(0,2,2)(2,1,1)[24]             : AIC=-183.755, Time=5.61 sec
 ARIMA(0,2,3)(0,1,0)[24]             : AIC=-187.669, Time=0.27 sec
 ARIMA(0,2,3)(0,1,1)[24]             : AIC=-186.244, Time=1.34 sec
 ARIMA(0,2,3)(0,1,2)[24]             : AIC=-185.166, Time=3.40 sec
 ARIMA(0,2,3)(1,1,0)[24]             : AIC=-186.478, Time=1.36 sec
 ARIMA(0,2,3)(1,1,1)[24]             : AIC=-184.523, Time=2.34 sec
 ARIMA(0,2,3)(2,1,0)[24]             : AIC=-184.598, Time=5.80 sec
 ARIMA(0,2,4)(0,1,0)[24]             : AIC=-179.043, Time=0.45 sec
 ARIMA(0,2,4)(0,1,1)[24]             : AIC=-182.627, Time=3.79 sec
 ARIMA(0,2,4)(1,1,0)[24]             : AIC=-182.035, Time=1.73 sec
 ARIMA(0,2,5)(0,1,0)[24]             : AIC=-186.193, Time=0.46 sec
 ARIMA(1,2,0)(0,1,0)[24]             : AIC=-181.527, Time=0.04 sec
 ARIMA(1,2,0)(0,1,1)[24]             : AIC=-179.527, Time=0.34 sec
 ARIMA(1,2,0)(0,1,2)[24]             : AIC=-177.527, Time=1.61 sec
 ARIMA(1,2,0)(1,1,0)[24]             : AIC=-179.519, Time=0.35 sec
 ARIMA(1,2,0)(1,1,1)[24]             : AIC=-177.527, Time=0.56 sec
 ARIMA(1,2,0)(1,1,2)[24]             : AIC=-175.527, Time=0.87 sec
 ARIMA(1,2,0)(2,1,0)[24]             : AIC=-177.527, Time=2.06 sec
 ARIMA(1,2,0)(2,1,1)[24]             : AIC=-175.527, Time=0.71 sec
 ARIMA(1,2,0)(2,1,2)[24]             : AIC=-173.527, Time=2.06 sec
 ARIMA(1,2,1)(0,1,0)[24]             : AIC=-187.721, Time=0.20 sec
 ARIMA(1,2,1)(0,1,1)[24]             : AIC=-186.257, Time=1.05 sec
 ARIMA(1,2,1)(0,1,2)[24]             : AIC=inf, Time=5.25 sec
 ARIMA(1,2,1)(1,1,0)[24]             : AIC=-186.185, Time=1.09 sec
 ARIMA(1,2,1)(1,1,1)[24]             : AIC=-184.344, Time=1.07 sec
 ARIMA(1,2,1)(1,1,2)[24]             : AIC=-183.749, Time=5.64 sec
 ARIMA(1,2,1)(2,1,0)[24]             : AIC=-186.561, Time=5.73 sec
 ARIMA(1,2,1)(2,1,1)[24]             : AIC=-183.211, Time=5.07 sec
 ARIMA(1,2,2)(0,1,0)[24]             : AIC=-190.708, Time=0.31 sec
 ARIMA(1,2,2)(0,1,1)[24]             : AIC=-187.757, Time=2.11 sec
 ARIMA(1,2,2)(0,1,2)[24]             : AIC=-183.763, Time=2.98 sec
 ARIMA(1,2,2)(1,1,0)[24]             : AIC=-187.495, Time=1.99 sec
 ARIMA(1,2,2)(1,1,1)[24]             : AIC=-185.842, Time=1.82 sec
 ARIMA(1,2,2)(2,1,0)[24]             : AIC=-186.618, Time=4.97 sec
 ARIMA(1,2,3)(0,1,0)[24]             : AIC=-187.480, Time=0.35 sec
 ARIMA(1,2,3)(0,1,1)[24]             : AIC=-183.869, Time=1.91 sec
 ARIMA(1,2,3)(1,1,0)[24]             : AIC=-184.631, Time=1.89 sec
 ARIMA(1,2,4)(0,1,0)[24]             : AIC=-190.527, Time=0.59 sec
 ARIMA(2,2,0)(0,1,0)[24]             : AIC=-181.537, Time=0.08 sec
 ARIMA(2,2,0)(0,1,1)[24]             : AIC=-179.537, Time=0.70 sec
 ARIMA(2,2,0)(0,1,2)[24]             : AIC=-177.537, Time=1.46 sec
 ARIMA(2,2,0)(1,1,0)[24]             : AIC=-179.544, Time=0.65 sec
 ARIMA(2,2,0)(1,1,1)[24]             : AIC=-177.537, Time=0.97 sec
 ARIMA(2,2,0)(1,1,2)[24]             : AIC=-175.537, Time=2.49 sec
 ARIMA(2,2,0)(2,1,0)[24]             : AIC=-177.537, Time=1.25 sec
 ARIMA(2,2,0)(2,1,1)[24]             : AIC=-175.537, Time=2.19 sec
 ARIMA(2,2,1)(0,1,0)[24]             : AIC=-185.283, Time=0.27 sec
 ARIMA(2,2,1)(0,1,1)[24]             : AIC=-181.486, Time=1.66 sec
 ARIMA(2,2,1)(0,1,2)[24]             : AIC=-183.570, Time=5.23 sec
 ARIMA(2,2,1)(1,1,0)[24]             : AIC=-182.502, Time=1.25 sec
 ARIMA(2,2,1)(1,1,1)[24]             : AIC=-183.040, Time=2.16 sec
 ARIMA(2,2,1)(2,1,0)[24]             : AIC=-184.493, Time=5.31 sec
 ARIMA(2,2,2)(0,1,0)[24]             : AIC=-188.317, Time=0.51 sec
 ARIMA(2,2,2)(0,1,1)[24]             : AIC=inf, Time=2.79 sec
 ARIMA(2,2,2)(1,1,0)[24]             : AIC=-185.590, Time=1.89 sec
 ARIMA(2,2,3)(0,1,0)[24]             : AIC=-183.145, Time=0.48 sec
 ARIMA(3,2,0)(0,1,0)[24]             : AIC=-183.598, Time=0.20 sec
 ARIMA(3,2,0)(0,1,1)[24]             : AIC=-182.122, Time=1.77 sec
 ARIMA(3,2,0)(0,1,2)[24]             : AIC=-180.938, Time=2.31 sec
 ARIMA(3,2,0)(1,1,0)[24]             : AIC=-183.052, Time=1.25 sec
 ARIMA(3,2,0)(1,1,1)[24]             : AIC=-180.041, Time=1.52 sec
 ARIMA(3,2,0)(2,1,0)[24]             : AIC=-180.685, Time=3.34 sec
 ARIMA(3,2,1)(0,1,0)[24]             : AIC=-188.882, Time=0.40 sec
 ARIMA(3,2,1)(0,1,1)[24]             : AIC=-186.530, Time=2.19 sec
 ARIMA(3,2,1)(1,1,0)[24]             : AIC=-186.681, Time=2.69 sec
 ARIMA(3,2,2)(0,1,0)[24]             : AIC=-188.522, Time=0.46 sec
 ARIMA(4,2,0)(0,1,0)[24]             : AIC=-184.556, Time=0.32 sec
 ARIMA(4,2,0)(0,1,1)[24]             : AIC=-181.657, Time=1.26 sec
 ARIMA(4,2,0)(1,1,0)[24]             : AIC=-181.091, Time=1.72 sec
 ARIMA(4,2,1)(0,1,0)[24]             : AIC=-187.470, Time=0.57 sec
 ARIMA(5,2,0)(0,1,0)[24]             : AIC=-196.056, Time=0.41 sec

Best model:  ARIMA(5,2,0)(0,1,0)[24]          
Total fit time: 183.255 seconds
                                     SARIMAX Results                                      
==========================================================================================
Dep. Variable:                                  y   No. Observations:                   56
Model:             SARIMAX(5, 2, 0)x(0, 1, 0, 24)   Log Likelihood                 104.028
Date:                            Fri, 24 Nov 2023   AIC                           -196.056
Time:                                    15:45:49   BIC                           -187.649
Sample:                                11-10-2021   HQIC                          -193.367
                                     - 11-30-2022                                         
Covariance Type:                              opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1         -1.1200      0.140     -7.988      0.000      -1.395      -0.845
ar.L2         -1.0810      0.186     -5.814      0.000      -1.445      -0.717
ar.L3         -1.0802      0.212     -5.100      0.000      -1.495      -0.665
ar.L4         -0.8488      0.200     -4.234      0.000      -1.242      -0.456
ar.L5         -0.5486      0.147     -3.742      0.000      -0.836      -0.261
sigma2      5.083e-05   1.41e-05      3.605      0.000    2.32e-05    7.85e-05
===================================================================================
Ljung-Box (L1) (Q):                   0.02   Jarque-Bera (JB):                 4.12
Prob(Q):                              0.88   Prob(JB):                         0.13
Heteroskedasticity (H):               0.05   Skew:                            -0.54
Prob(H) (two-sided):                  0.00   Kurtosis:                         4.45
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
AIC: -196.05605941316932
Code
# Train results
train_pred = model.predict_in_sample()
# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = model.predict(n_periods=len(test_aar))

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")
Train RMSE: 0.016412036571477613
Test RMSE: 0.0035731612930503405

Oddly enough, again, the test RMSE is lower than the train RMSE after employing this search method. To restate, I infer that this might be because the test data inherently has less variability and follows a pattern that is more easily predicted by the model than the training data. Also, the model may have overfit to the noise in the training data leading to higher errors on that train set although it was able to generalize better to test data. However, this is definitely the largest challenge I have faced when creating the auto_arima model.

Because of this unordinary result, I wanted to employ cross validation techniques to see if I could get more standard results. I defined a time series cross-validation function (time_series_cv) to take the dataset, three cross validation splits, and a horizon which is the number of time steps ahead for which I will forecast and evaluate the model during each fold of the cross-validation process (essentially the size of the fold). The dataset is split based on the length of each segment with one segment used for testing and the rest for training. The loop runs for each split, incrementing the training dataset and testing the next segment. Then, auto_arima fits the model to the training data trying different combinations of parameters. Finally, test predictions are made.

I was unable to do the same configuration as my best model because when I set D = 1 and m=24, I get an error saying the values are too high because my dataset is so small. There are not enough observations in each fold to accommodate for those parameters. Therefore, for illustrative purposes, I chose to cross validate with D=0 and another with m=13 to show that I achieved pretty similar results although the validated RMSEs are higher.

Code
# Time Series Cross-Validation
def time_series_cv(data, n_splits, horizon):
    tscv_results = []
    split_length = int(len(data) / (n_splits + 1))

    for i in range(n_splits):
        train = data[:split_length*(i+1)]
        test = data[split_length*(i+1):split_length*(i+1) + horizon]

        model = auto_arima(train, start_p=0, start_q=0, max_p=7, max_q=7, m=24,start_P=0, seasonal=True, d=2, D = 0, trace=True,
                        error_action='ignore', suppress_warnings=True, stepwise=False)

        test_pred = model.predict(n_periods=horizon)
        rmse = np.sqrt(mean_squared_error(test, test_pred))
        tscv_results.append(rmse)

    return np.mean(tscv_results)

# Runing Time Series Cross-Validation
cv_rmse = time_series_cv(df_scaled_diff, n_splits=3, horizon=13)
print(f"Average RMSE from Time Series Cross-Validation: {cv_rmse}")
 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-90.082, Time=0.03 sec
 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-88.082, Time=0.11 sec
 ARIMA(0,2,0)(0,0,2)[24]             : AIC=-86.082, Time=0.24 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-88.082, Time=0.22 sec
 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-86.082, Time=0.04 sec
 ARIMA(0,2,0)(1,0,2)[24]             : AIC=-84.082, Time=0.31 sec
 ARIMA(0,2,0)(2,0,0)[24]             : AIC=-86.082, Time=0.23 sec
 ARIMA(0,2,0)(2,0,1)[24]             : AIC=-84.082, Time=0.34 sec
 ARIMA(0,2,0)(2,0,2)[24]             : AIC=-82.082, Time=0.81 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=inf, Time=0.04 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=inf, Time=0.09 sec
 ARIMA(0,2,1)(0,0,2)[24]             : AIC=inf, Time=0.43 sec
 ARIMA(0,2,1)(1,0,0)[24]             : AIC=inf, Time=0.14 sec
 ARIMA(0,2,1)(1,0,1)[24]             : AIC=inf, Time=0.13 sec
 ARIMA(0,2,1)(1,0,2)[24]             : AIC=inf, Time=0.64 sec
 ARIMA(0,2,1)(2,0,0)[24]             : AIC=inf, Time=0.76 sec
 ARIMA(0,2,1)(2,0,1)[24]             : AIC=inf, Time=0.71 sec
 ARIMA(0,2,1)(2,0,2)[24]             : AIC=inf, Time=1.04 sec
 ARIMA(0,2,2)(0,0,0)[24]             : AIC=inf, Time=0.04 sec
 ARIMA(0,2,2)(0,0,1)[24]             : AIC=-97.864, Time=0.18 sec
 ARIMA(0,2,2)(0,0,2)[24]             : AIC=-95.990, Time=0.70 sec
 ARIMA(0,2,2)(1,0,0)[24]             : AIC=-97.070, Time=0.08 sec
 ARIMA(0,2,2)(1,0,1)[24]             : AIC=-95.655, Time=0.59 sec
 ARIMA(0,2,2)(1,0,2)[24]             : AIC=-94.230, Time=0.90 sec
 ARIMA(0,2,2)(2,0,0)[24]             : AIC=-96.235, Time=0.79 sec
 ARIMA(0,2,2)(2,0,1)[24]             : AIC=-94.005, Time=0.97 sec
 ARIMA(0,2,3)(0,0,0)[24]             : AIC=-98.423, Time=0.05 sec
 ARIMA(0,2,3)(0,0,1)[24]             : AIC=-96.301, Time=0.52 sec
 ARIMA(0,2,3)(0,0,2)[24]             : AIC=-93.912, Time=1.11 sec
 ARIMA(0,2,3)(1,0,0)[24]             : AIC=-95.713, Time=0.19 sec
 ARIMA(0,2,3)(1,0,1)[24]             : AIC=-93.707, Time=0.27 sec
 ARIMA(0,2,3)(2,0,0)[24]             : AIC=-93.928, Time=0.91 sec
 ARIMA(0,2,4)(0,0,0)[24]             : AIC=-96.186, Time=0.09 sec
 ARIMA(0,2,4)(0,0,1)[24]             : AIC=-94.826, Time=0.46 sec
 ARIMA(0,2,4)(1,0,0)[24]             : AIC=-93.948, Time=0.16 sec
 ARIMA(0,2,5)(0,0,0)[24]             : AIC=-94.118, Time=0.07 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-94.916, Time=0.02 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-92.898, Time=0.02 sec
 ARIMA(1,2,0)(0,0,2)[24]             : AIC=-90.898, Time=0.12 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-92.898, Time=0.04 sec
 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-90.898, Time=0.09 sec
 ARIMA(1,2,0)(1,0,2)[24]             : AIC=-88.898, Time=0.17 sec
 ARIMA(1,2,0)(2,0,0)[24]             : AIC=-90.898, Time=0.19 sec
 ARIMA(1,2,0)(2,0,1)[24]             : AIC=-88.898, Time=0.33 sec
 ARIMA(1,2,0)(2,0,2)[24]             : AIC=-86.898, Time=0.72 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-99.874, Time=0.06 sec
 ARIMA(1,2,1)(0,0,1)[24]             : AIC=-97.921, Time=0.24 sec
 ARIMA(1,2,1)(0,0,2)[24]             : AIC=-95.910, Time=1.05 sec
 ARIMA(1,2,1)(1,0,0)[24]             : AIC=inf, Time=0.18 sec
 ARIMA(1,2,1)(1,0,1)[24]             : AIC=-95.887, Time=0.41 sec
 ARIMA(1,2,1)(1,0,2)[24]             : AIC=-93.844, Time=1.24 sec
 ARIMA(1,2,1)(2,0,0)[24]             : AIC=inf, Time=0.78 sec
 ARIMA(1,2,1)(2,0,1)[24]             : AIC=-93.700, Time=1.00 sec
 ARIMA(1,2,2)(0,0,0)[24]             : AIC=-97.852, Time=0.06 sec
 ARIMA(1,2,2)(0,0,1)[24]             : AIC=inf, Time=0.17 sec
 ARIMA(1,2,2)(0,0,2)[24]             : AIC=inf, Time=0.64 sec
 ARIMA(1,2,2)(1,0,0)[24]             : AIC=inf, Time=0.37 sec
 ARIMA(1,2,2)(1,0,1)[24]             : AIC=-93.807, Time=0.52 sec
 ARIMA(1,2,2)(2,0,0)[24]             : AIC=-93.811, Time=0.69 sec
 ARIMA(1,2,3)(0,0,0)[24]             : AIC=-96.383, Time=0.06 sec
 ARIMA(1,2,3)(0,0,1)[24]             : AIC=-94.469, Time=0.44 sec
 ARIMA(1,2,3)(1,0,0)[24]             : AIC=-94.302, Time=0.35 sec
 ARIMA(1,2,4)(0,0,0)[24]             : AIC=-94.629, Time=0.11 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-94.294, Time=0.02 sec
 ARIMA(2,2,0)(0,0,1)[24]             : AIC=-92.294, Time=0.10 sec
 ARIMA(2,2,0)(0,0,2)[24]             : AIC=-90.294, Time=0.23 sec
 ARIMA(2,2,0)(1,0,0)[24]             : AIC=-92.294, Time=0.07 sec
 ARIMA(2,2,0)(1,0,1)[24]             : AIC=-90.294, Time=0.06 sec
 ARIMA(2,2,0)(1,0,2)[24]             : AIC=-88.294, Time=0.19 sec
 ARIMA(2,2,0)(2,0,0)[24]             : AIC=-90.294, Time=0.23 sec
 ARIMA(2,2,0)(2,0,1)[24]             : AIC=-88.294, Time=0.43 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-97.975, Time=0.08 sec
 ARIMA(2,2,1)(0,0,1)[24]             : AIC=-96.017, Time=0.47 sec
 ARIMA(2,2,1)(0,0,2)[24]             : AIC=-93.955, Time=0.93 sec
 ARIMA(2,2,1)(1,0,0)[24]             : AIC=-96.034, Time=0.40 sec
 ARIMA(2,2,1)(1,0,1)[24]             : AIC=-94.030, Time=0.39 sec
 ARIMA(2,2,1)(2,0,0)[24]             : AIC=-93.899, Time=0.89 sec
 ARIMA(2,2,2)(0,0,0)[24]             : AIC=-95.651, Time=0.11 sec
 ARIMA(2,2,2)(0,0,1)[24]             : AIC=-93.793, Time=0.50 sec
 ARIMA(2,2,2)(1,0,0)[24]             : AIC=-93.767, Time=0.32 sec
 ARIMA(2,2,3)(0,0,0)[24]             : AIC=-93.686, Time=0.18 sec
 ARIMA(3,2,0)(0,0,0)[24]             : AIC=-96.240, Time=0.08 sec
 ARIMA(3,2,0)(0,0,1)[24]             : AIC=-94.248, Time=0.21 sec
 ARIMA(3,2,0)(0,0,2)[24]             : AIC=-92.255, Time=0.64 sec
 ARIMA(3,2,0)(1,0,0)[24]             : AIC=-94.263, Time=0.24 sec
 ARIMA(3,2,0)(1,0,1)[24]             : AIC=-92.262, Time=0.95 sec
 ARIMA(3,2,0)(2,0,0)[24]             : AIC=-92.259, Time=1.34 sec
 ARIMA(3,2,1)(0,0,0)[24]             : AIC=-97.047, Time=0.11 sec
 ARIMA(3,2,1)(0,0,1)[24]             : AIC=-95.129, Time=0.25 sec
 ARIMA(3,2,1)(1,0,0)[24]             : AIC=-95.021, Time=0.31 sec
 ARIMA(3,2,2)(0,0,0)[24]             : AIC=-96.376, Time=0.20 sec
 ARIMA(4,2,0)(0,0,0)[24]             : AIC=-96.841, Time=0.07 sec
 ARIMA(4,2,0)(0,0,1)[24]             : AIC=-94.954, Time=1.28 sec
 ARIMA(4,2,0)(1,0,0)[24]             : AIC=-95.032, Time=0.44 sec
 ARIMA(4,2,1)(0,0,0)[24]             : AIC=-95.576, Time=0.09 sec
 ARIMA(5,2,0)(0,0,0)[24]             : AIC=-95.782, Time=0.09 sec

Best model:  ARIMA(1,2,1)(0,0,0)[24]          
Total fit time: 36.447 seconds
 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-206.306, Time=0.02 sec
 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-204.306, Time=0.27 sec
 ARIMA(0,2,0)(0,0,2)[24]             : AIC=-202.306, Time=0.72 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-204.306, Time=0.08 sec
 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-202.306, Time=0.22 sec
 ARIMA(0,2,0)(1,0,2)[24]             : AIC=-200.306, Time=0.49 sec
 ARIMA(0,2,0)(2,0,0)[24]             : AIC=-202.306, Time=0.25 sec
 ARIMA(0,2,0)(2,0,1)[24]             : AIC=-200.306, Time=0.70 sec
 ARIMA(0,2,0)(2,0,2)[24]             : AIC=-198.306, Time=0.56 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=inf, Time=0.02 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=-232.137, Time=0.08 sec
 ARIMA(0,2,1)(0,0,2)[24]             : AIC=-230.821, Time=0.72 sec
 ARIMA(0,2,1)(1,0,0)[24]             : AIC=-232.972, Time=0.23 sec
 ARIMA(0,2,1)(1,0,1)[24]             : AIC=-228.142, Time=0.07 sec
 ARIMA(0,2,1)(1,0,2)[24]             : AIC=-226.142, Time=0.21 sec
 ARIMA(0,2,1)(2,0,0)[24]             : AIC=-230.638, Time=1.24 sec
 ARIMA(0,2,1)(2,0,1)[24]             : AIC=-226.142, Time=0.18 sec
 ARIMA(0,2,1)(2,0,2)[24]             : AIC=-224.142, Time=0.25 sec
 ARIMA(0,2,2)(0,0,0)[24]             : AIC=-236.867, Time=0.15 sec
 ARIMA(0,2,2)(0,0,1)[24]             : AIC=-235.344, Time=0.18 sec
 ARIMA(0,2,2)(0,0,2)[24]             : AIC=-233.351, Time=0.87 sec
 ARIMA(0,2,2)(1,0,0)[24]             : AIC=-235.346, Time=0.29 sec
 ARIMA(0,2,2)(1,0,1)[24]             : AIC=-233.219, Time=0.22 sec
 ARIMA(0,2,2)(1,0,2)[24]             : AIC=-230.763, Time=1.15 sec
 ARIMA(0,2,2)(2,0,0)[24]             : AIC=-232.743, Time=0.93 sec
 ARIMA(0,2,2)(2,0,1)[24]             : AIC=-230.845, Time=1.03 sec
 ARIMA(0,2,3)(0,0,0)[24]             : AIC=-235.021, Time=0.07 sec
 ARIMA(0,2,3)(0,0,1)[24]             : AIC=-233.000, Time=0.75 sec
 ARIMA(0,2,3)(0,0,2)[24]             : AIC=-231.085, Time=1.16 sec
 ARIMA(0,2,3)(1,0,0)[24]             : AIC=-232.847, Time=0.27 sec
 ARIMA(0,2,3)(1,0,1)[24]             : AIC=-231.286, Time=0.56 sec
 ARIMA(0,2,3)(2,0,0)[24]             : AIC=-231.524, Time=1.12 sec
 ARIMA(0,2,4)(0,0,0)[24]             : AIC=-233.585, Time=0.08 sec
 ARIMA(0,2,4)(0,0,1)[24]             : AIC=-231.540, Time=0.50 sec
 ARIMA(0,2,4)(1,0,0)[24]             : AIC=-231.592, Time=0.39 sec
 ARIMA(0,2,5)(0,0,0)[24]             : AIC=-235.314, Time=0.08 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-221.224, Time=0.01 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-219.392, Time=0.15 sec
 ARIMA(1,2,0)(0,0,2)[24]             : AIC=-217.393, Time=0.35 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-219.393, Time=0.12 sec
 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-217.391, Time=0.28 sec
 ARIMA(1,2,0)(1,0,2)[24]             : AIC=-215.393, Time=0.59 sec
 ARIMA(1,2,0)(2,0,0)[24]             : AIC=-217.390, Time=0.32 sec
 ARIMA(1,2,0)(2,0,1)[24]             : AIC=-215.391, Time=0.85 sec
 ARIMA(1,2,0)(2,0,2)[24]             : AIC=-213.393, Time=1.00 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-236.324, Time=0.04 sec
 ARIMA(1,2,1)(0,0,1)[24]             : AIC=-234.282, Time=0.66 sec
 ARIMA(1,2,1)(0,0,2)[24]             : AIC=-232.146, Time=1.11 sec
 ARIMA(1,2,1)(1,0,0)[24]             : AIC=-234.339, Time=0.30 sec
 ARIMA(1,2,1)(1,0,1)[24]             : AIC=-232.197, Time=0.34 sec
 ARIMA(1,2,1)(1,0,2)[24]             : AIC=-230.340, Time=1.23 sec
 ARIMA(1,2,1)(2,0,0)[24]             : AIC=-232.344, Time=1.75 sec
 ARIMA(1,2,1)(2,0,1)[24]             : AIC=-229.495, Time=1.83 sec
 ARIMA(1,2,2)(0,0,0)[24]             : AIC=-233.505, Time=0.06 sec
 ARIMA(1,2,2)(0,0,1)[24]             : AIC=-231.581, Time=0.26 sec
 ARIMA(1,2,2)(0,0,2)[24]             : AIC=-229.598, Time=2.14 sec
 ARIMA(1,2,2)(1,0,0)[24]             : AIC=-231.576, Time=0.73 sec
 ARIMA(1,2,2)(1,0,1)[24]             : AIC=-229.586, Time=0.65 sec
 ARIMA(1,2,2)(2,0,0)[24]             : AIC=-229.586, Time=1.44 sec
 ARIMA(1,2,3)(0,0,0)[24]             : AIC=-233.028, Time=0.07 sec
 ARIMA(1,2,3)(0,0,1)[24]             : AIC=-231.433, Time=0.37 sec
 ARIMA(1,2,3)(1,0,0)[24]             : AIC=-230.745, Time=0.28 sec
 ARIMA(1,2,4)(0,0,0)[24]             : AIC=-231.702, Time=0.08 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-223.699, Time=0.01 sec
 ARIMA(2,2,0)(0,0,1)[24]             : AIC=-221.699, Time=0.37 sec
 ARIMA(2,2,0)(0,0,2)[24]             : AIC=-219.699, Time=0.20 sec
 ARIMA(2,2,0)(1,0,0)[24]             : AIC=-221.703, Time=0.08 sec
 ARIMA(2,2,0)(1,0,1)[24]             : AIC=-219.699, Time=0.09 sec
 ARIMA(2,2,0)(1,0,2)[24]             : AIC=-217.699, Time=0.18 sec
 ARIMA(2,2,0)(2,0,0)[24]             : AIC=-219.699, Time=0.30 sec
 ARIMA(2,2,0)(2,0,1)[24]             : AIC=-217.699, Time=0.34 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-234.735, Time=0.06 sec
 ARIMA(2,2,1)(0,0,1)[24]             : AIC=-232.738, Time=0.35 sec
 ARIMA(2,2,1)(0,0,2)[24]             : AIC=-230.724, Time=0.88 sec
 ARIMA(2,2,1)(1,0,0)[24]             : AIC=-232.740, Time=0.27 sec
 ARIMA(2,2,1)(1,0,1)[24]             : AIC=-230.601, Time=0.49 sec
 ARIMA(2,2,1)(2,0,0)[24]             : AIC=-230.740, Time=1.16 sec
 ARIMA(2,2,2)(0,0,0)[24]             : AIC=-233.498, Time=0.06 sec
 ARIMA(2,2,2)(0,0,1)[24]             : AIC=-231.338, Time=0.40 sec
 ARIMA(2,2,2)(1,0,0)[24]             : AIC=-231.259, Time=0.38 sec
 ARIMA(2,2,3)(0,0,0)[24]             : AIC=-228.642, Time=0.05 sec
 ARIMA(3,2,0)(0,0,0)[24]             : AIC=-229.414, Time=0.07 sec
 ARIMA(3,2,0)(0,0,1)[24]             : AIC=-227.466, Time=0.22 sec
 ARIMA(3,2,0)(0,0,2)[24]             : AIC=-225.478, Time=0.80 sec
 ARIMA(3,2,0)(1,0,0)[24]             : AIC=-227.475, Time=0.52 sec
 ARIMA(3,2,0)(1,0,1)[24]             : AIC=-225.484, Time=0.50 sec
 ARIMA(3,2,0)(2,0,0)[24]             : AIC=-225.475, Time=1.53 sec
 ARIMA(3,2,1)(0,0,0)[24]             : AIC=-234.323, Time=0.10 sec
 ARIMA(3,2,1)(0,0,1)[24]             : AIC=-232.375, Time=0.37 sec
 ARIMA(3,2,1)(1,0,0)[24]             : AIC=-232.384, Time=0.98 sec
 ARIMA(3,2,2)(0,0,0)[24]             : AIC=-232.754, Time=0.09 sec
 ARIMA(4,2,0)(0,0,0)[24]             : AIC=-234.092, Time=0.07 sec
 ARIMA(4,2,0)(0,0,1)[24]             : AIC=-233.252, Time=0.41 sec
 ARIMA(4,2,0)(1,0,0)[24]             : AIC=-233.227, Time=0.65 sec
 ARIMA(4,2,1)(0,0,0)[24]             : AIC=-233.841, Time=0.09 sec
 ARIMA(5,2,0)(0,0,0)[24]             : AIC=-234.434, Time=0.08 sec

Best model:  ARIMA(0,2,2)(0,0,0)[24]          
Total fit time: 45.356 seconds
 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-339.184, Time=0.01 sec
 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-337.184, Time=0.10 sec
 ARIMA(0,2,0)(0,0,2)[24]             : AIC=-335.184, Time=0.45 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-337.184, Time=0.11 sec
 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-335.184, Time=0.98 sec
 ARIMA(0,2,0)(1,0,2)[24]             : AIC=-333.184, Time=0.79 sec
 ARIMA(0,2,0)(2,0,0)[24]             : AIC=-335.160, Time=1.16 sec
 ARIMA(0,2,0)(2,0,1)[24]             : AIC=-333.184, Time=0.46 sec
 ARIMA(0,2,0)(2,0,2)[24]             : AIC=-331.184, Time=0.56 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=-385.218, Time=0.03 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=-378.052, Time=0.04 sec
 ARIMA(0,2,1)(0,0,2)[24]             : AIC=-381.254, Time=1.77 sec
 ARIMA(0,2,1)(1,0,0)[24]             : AIC=-383.258, Time=0.42 sec
 ARIMA(0,2,1)(1,0,1)[24]             : AIC=-381.258, Time=0.51 sec
 ARIMA(0,2,1)(1,0,2)[24]             : AIC=-379.256, Time=1.38 sec
 ARIMA(0,2,1)(2,0,0)[24]             : AIC=-381.255, Time=1.07 sec
 ARIMA(0,2,1)(2,0,1)[24]             : AIC=-374.052, Time=0.83 sec
 ARIMA(0,2,1)(2,0,2)[24]             : AIC=-372.052, Time=0.86 sec
 ARIMA(0,2,2)(0,0,0)[24]             : AIC=-389.982, Time=0.06 sec
 ARIMA(0,2,2)(0,0,1)[24]             : AIC=-388.040, Time=0.47 sec
 ARIMA(0,2,2)(0,0,2)[24]             : AIC=-384.797, Time=0.55 sec
 ARIMA(0,2,2)(1,0,0)[24]             : AIC=-387.964, Time=0.35 sec
 ARIMA(0,2,2)(1,0,1)[24]             : AIC=-385.707, Time=0.85 sec
 ARIMA(0,2,2)(1,0,2)[24]             : AIC=-383.737, Time=2.42 sec
 ARIMA(0,2,2)(2,0,0)[24]             : AIC=-386.085, Time=1.92 sec
 ARIMA(0,2,2)(2,0,1)[24]             : AIC=-384.036, Time=1.87 sec
 ARIMA(0,2,3)(0,0,0)[24]             : AIC=-386.924, Time=0.04 sec
 ARIMA(0,2,3)(0,0,1)[24]             : AIC=-385.122, Time=0.40 sec
 ARIMA(0,2,3)(0,0,2)[24]             : AIC=-382.939, Time=0.75 sec
 ARIMA(0,2,3)(1,0,0)[24]             : AIC=-385.667, Time=0.40 sec
 ARIMA(0,2,3)(1,0,1)[24]             : AIC=-382.960, Time=0.34 sec
 ARIMA(0,2,3)(2,0,0)[24]             : AIC=-383.124, Time=1.15 sec
 ARIMA(0,2,4)(0,0,0)[24]             : AIC=-385.992, Time=0.10 sec
 ARIMA(0,2,4)(0,0,1)[24]             : AIC=-382.049, Time=0.14 sec
 ARIMA(0,2,4)(1,0,0)[24]             : AIC=-382.074, Time=0.33 sec
 ARIMA(0,2,5)(0,0,0)[24]             : AIC=-390.813, Time=0.12 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-363.269, Time=0.01 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-361.269, Time=0.04 sec
 ARIMA(1,2,0)(0,0,2)[24]             : AIC=-359.269, Time=0.14 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-361.279, Time=0.08 sec
 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-359.269, Time=0.05 sec
 ARIMA(1,2,0)(1,0,2)[24]             : AIC=-357.670, Time=0.85 sec
 ARIMA(1,2,0)(2,0,0)[24]             : AIC=-359.673, Time=0.90 sec
 ARIMA(1,2,0)(2,0,1)[24]             : AIC=-357.269, Time=0.19 sec
 ARIMA(1,2,0)(2,0,2)[24]             : AIC=-355.269, Time=0.39 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-388.292, Time=0.04 sec
 ARIMA(1,2,1)(0,0,1)[24]             : AIC=-385.495, Time=0.34 sec
 ARIMA(1,2,1)(0,0,2)[24]             : AIC=-383.436, Time=1.12 sec
 ARIMA(1,2,1)(1,0,0)[24]             : AIC=-386.323, Time=0.58 sec
 ARIMA(1,2,1)(1,0,1)[24]             : AIC=-382.230, Time=0.52 sec
 ARIMA(1,2,1)(1,0,2)[24]             : AIC=-381.484, Time=1.61 sec
 ARIMA(1,2,1)(2,0,0)[24]             : AIC=-382.511, Time=1.32 sec
 ARIMA(1,2,1)(2,0,1)[24]             : AIC=-380.609, Time=1.63 sec
 ARIMA(1,2,2)(0,0,0)[24]             : AIC=-384.917, Time=0.06 sec
 ARIMA(1,2,2)(0,0,1)[24]             : AIC=-383.193, Time=0.42 sec
 ARIMA(1,2,2)(0,0,2)[24]             : AIC=-381.192, Time=1.59 sec
 ARIMA(1,2,2)(1,0,0)[24]             : AIC=-383.219, Time=0.58 sec
 ARIMA(1,2,2)(1,0,1)[24]             : AIC=-381.091, Time=0.83 sec
 ARIMA(1,2,2)(2,0,0)[24]             : AIC=-380.838, Time=1.67 sec
 ARIMA(1,2,3)(0,0,0)[24]             : AIC=-384.497, Time=0.03 sec
 ARIMA(1,2,3)(0,0,1)[24]             : AIC=-383.819, Time=0.68 sec
 ARIMA(1,2,3)(1,0,0)[24]             : AIC=-382.499, Time=0.15 sec
 ARIMA(1,2,4)(0,0,0)[24]             : AIC=-383.571, Time=0.16 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-368.235, Time=0.05 sec
 ARIMA(2,2,0)(0,0,1)[24]             : AIC=-366.235, Time=0.25 sec
 ARIMA(2,2,0)(0,0,2)[24]             : AIC=-364.235, Time=0.19 sec
 ARIMA(2,2,0)(1,0,0)[24]             : AIC=-366.239, Time=0.36 sec
 ARIMA(2,2,0)(1,0,1)[24]             : AIC=-364.235, Time=0.65 sec
 ARIMA(2,2,0)(1,0,2)[24]             : AIC=-362.235, Time=1.25 sec
 ARIMA(2,2,0)(2,0,0)[24]             : AIC=-364.327, Time=0.94 sec
 ARIMA(2,2,0)(2,0,1)[24]             : AIC=-362.235, Time=0.32 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-386.737, Time=0.04 sec
 ARIMA(2,2,1)(0,0,1)[24]             : AIC=-384.882, Time=0.45 sec
 ARIMA(2,2,1)(0,0,2)[24]             : AIC=-382.193, Time=1.40 sec
 ARIMA(2,2,1)(1,0,0)[24]             : AIC=-383.327, Time=0.42 sec
 ARIMA(2,2,1)(1,0,1)[24]             : AIC=-382.734, Time=0.60 sec
 ARIMA(2,2,1)(2,0,0)[24]             : AIC=-382.244, Time=1.03 sec
 ARIMA(2,2,2)(0,0,0)[24]             : AIC=-384.575, Time=0.07 sec
 ARIMA(2,2,2)(0,0,1)[24]             : AIC=-382.161, Time=0.63 sec
 ARIMA(2,2,2)(1,0,0)[24]             : AIC=-383.474, Time=0.49 sec
 ARIMA(2,2,3)(0,0,0)[24]             : AIC=-380.420, Time=0.03 sec
 ARIMA(3,2,0)(0,0,0)[24]             : AIC=-376.637, Time=0.02 sec
 ARIMA(3,2,0)(0,0,1)[24]             : AIC=-375.387, Time=0.11 sec
 ARIMA(3,2,0)(0,0,2)[24]             : AIC=-372.683, Time=0.74 sec
 ARIMA(3,2,0)(1,0,0)[24]             : AIC=-375.361, Time=0.45 sec
 ARIMA(3,2,0)(1,0,1)[24]             : AIC=-373.389, Time=0.46 sec
 ARIMA(3,2,0)(2,0,0)[24]             : AIC=-373.358, Time=1.84 sec
 ARIMA(3,2,1)(0,0,0)[24]             : AIC=-387.267, Time=0.07 sec
 ARIMA(3,2,1)(0,0,1)[24]             : AIC=-385.280, Time=0.73 sec
 ARIMA(3,2,1)(1,0,0)[24]             : AIC=-385.616, Time=0.51 sec
 ARIMA(3,2,2)(0,0,0)[24]             : AIC=-386.250, Time=0.04 sec
 ARIMA(4,2,0)(0,0,0)[24]             : AIC=-384.590, Time=0.07 sec
 ARIMA(4,2,0)(0,0,1)[24]             : AIC=-383.111, Time=0.50 sec
 ARIMA(4,2,0)(1,0,0)[24]             : AIC=-383.343, Time=0.90 sec
 ARIMA(4,2,1)(0,0,0)[24]             : AIC=-387.143, Time=0.11 sec
 ARIMA(5,2,0)(0,0,0)[24]             : AIC=-387.037, Time=0.20 sec

Best model:  ARIMA(0,2,5)(0,0,0)[24]          
Total fit time: 55.698 seconds
Average RMSE from Time Series Cross-Validation: 0.010353322216418647
Code
# Time Series Cross-Validation
def time_series_cv(data, n_splits, horizon):
    tscv_results = []
    split_length = int(len(data) / (n_splits + 1))

    for i in range(n_splits):
        train = data[:split_length*(i+1)]
        test = data[split_length*(i+1):split_length*(i+1) + horizon]

        model = auto_arima(train, start_p=0, start_q=0, max_p=7, max_q=7, m=13,start_P=0, seasonal=True, d=2, D = 1, trace=True,
                        error_action='ignore', suppress_warnings=True, stepwise=False)

        test_pred = model.predict(n_periods=horizon)
        rmse = np.sqrt(mean_squared_error(test, test_pred))
        tscv_results.append(rmse)

    return np.mean(tscv_results)

# Runing Time Series Cross-Validation
cv_rmse = time_series_cv(df_scaled_diff, n_splits=3, horizon=13)
print(f"Average RMSE from Time Series Cross-Validation: {cv_rmse}")
 ARIMA(0,2,0)(0,1,0)[13]             : AIC=-13.633, Time=0.04 sec
 ARIMA(0,2,0)(0,1,1)[13]             : AIC=-11.633, Time=0.10 sec
 ARIMA(0,2,0)(0,1,2)[13]             : AIC=-9.633, Time=0.43 sec
 ARIMA(0,2,0)(1,1,0)[13]             : AIC=-11.633, Time=0.08 sec
 ARIMA(0,2,0)(1,1,1)[13]             : AIC=-9.633, Time=0.02 sec
 ARIMA(0,2,0)(1,1,2)[13]             : AIC=-7.633, Time=0.29 sec
 ARIMA(0,2,0)(2,1,0)[13]             : AIC=-9.633, Time=0.11 sec
 ARIMA(0,2,0)(2,1,1)[13]             : AIC=-7.633, Time=1.14 sec
 ARIMA(0,2,0)(2,1,2)[13]             : AIC=-5.633, Time=0.78 sec
 ARIMA(0,2,1)(0,1,0)[13]             : AIC=-14.880, Time=0.06 sec
 ARIMA(0,2,1)(0,1,1)[13]             : AIC=-12.875, Time=0.36 sec
 ARIMA(0,2,1)(0,1,2)[13]             : AIC=-10.879, Time=0.61 sec
 ARIMA(0,2,1)(1,1,0)[13]             : AIC=-12.803, Time=0.11 sec
 ARIMA(0,2,1)(1,1,1)[13]             : AIC=-10.853, Time=0.49 sec
 ARIMA(0,2,1)(1,1,2)[13]             : AIC=-8.849, Time=0.26 sec
 ARIMA(0,2,1)(2,1,0)[13]             : AIC=-10.825, Time=0.44 sec
 ARIMA(0,2,1)(2,1,1)[13]             : AIC=-8.775, Time=0.27 sec
 ARIMA(0,2,1)(2,1,2)[13]             : AIC=-6.861, Time=0.59 sec
 ARIMA(0,2,2)(0,1,0)[13]             : AIC=-14.468, Time=0.10 sec
 ARIMA(0,2,2)(0,1,1)[13]             : AIC=-12.436, Time=0.26 sec
 ARIMA(0,2,2)(0,1,2)[13]             : AIC=-10.554, Time=0.59 sec
 ARIMA(0,2,2)(1,1,0)[13]             : AIC=-12.404, Time=0.25 sec
 ARIMA(0,2,2)(1,1,1)[13]             : AIC=-10.505, Time=0.14 sec
 ARIMA(0,2,2)(1,1,2)[13]             : AIC=-8.453, Time=1.13 sec
 ARIMA(0,2,2)(2,1,0)[13]             : AIC=-10.447, Time=0.40 sec
 ARIMA(0,2,2)(2,1,1)[13]             : AIC=-8.424, Time=0.53 sec
 ARIMA(0,2,3)(0,1,0)[13]             : AIC=-12.753, Time=0.08 sec
 ARIMA(0,2,3)(0,1,1)[13]             : AIC=-10.703, Time=0.39 sec
 ARIMA(0,2,3)(0,1,2)[13]             : AIC=-8.741, Time=1.03 sec
 ARIMA(0,2,3)(1,1,0)[13]             : AIC=-10.738, Time=0.39 sec
 ARIMA(0,2,3)(1,1,1)[13]             : AIC=-8.707, Time=0.49 sec
 ARIMA(0,2,3)(2,1,0)[13]             : AIC=-8.735, Time=0.64 sec
 ARIMA(0,2,4)(0,1,0)[13]             : AIC=-10.769, Time=0.24 sec
 ARIMA(0,2,4)(0,1,1)[13]             : AIC=-8.763, Time=0.68 sec
 ARIMA(0,2,4)(1,1,0)[13]             : AIC=-8.702, Time=0.24 sec
 ARIMA(0,2,5)(0,1,0)[13]             : AIC=-8.821, Time=0.12 sec
 ARIMA(1,2,0)(0,1,0)[13]             : AIC=-14.310, Time=0.02 sec
 ARIMA(1,2,0)(0,1,1)[13]             : AIC=-13.259, Time=0.19 sec
 ARIMA(1,2,0)(0,1,2)[13]             : AIC=-10.954, Time=0.62 sec
 ARIMA(1,2,0)(1,1,0)[13]             : AIC=-13.266, Time=0.16 sec
 ARIMA(1,2,0)(1,1,1)[13]             : AIC=-11.039, Time=0.29 sec
 ARIMA(1,2,0)(1,1,2)[13]             : AIC=inf, Time=0.43 sec
 ARIMA(1,2,0)(2,1,0)[13]             : AIC=-11.212, Time=0.37 sec
 ARIMA(1,2,0)(2,1,1)[13]             : AIC=-9.089, Time=0.76 sec
 ARIMA(1,2,0)(2,1,2)[13]             : AIC=-6.828, Time=0.75 sec
 ARIMA(1,2,1)(0,1,0)[13]             : AIC=-14.381, Time=0.10 sec
 ARIMA(1,2,1)(0,1,1)[13]             : AIC=-12.212, Time=0.18 sec
 ARIMA(1,2,1)(0,1,2)[13]             : AIC=-10.036, Time=0.50 sec
 ARIMA(1,2,1)(1,1,0)[13]             : AIC=-12.289, Time=0.21 sec
 ARIMA(1,2,1)(1,1,1)[13]             : AIC=-10.248, Time=0.41 sec
 ARIMA(1,2,1)(1,1,2)[13]             : AIC=-8.251, Time=0.59 sec
 ARIMA(1,2,1)(2,1,0)[13]             : AIC=-10.384, Time=0.56 sec
 ARIMA(1,2,1)(2,1,1)[13]             : AIC=-8.245, Time=0.79 sec
 ARIMA(1,2,2)(0,1,0)[13]             : AIC=-12.681, Time=0.09 sec
 ARIMA(1,2,2)(0,1,1)[13]             : AIC=-10.164, Time=0.14 sec
 ARIMA(1,2,2)(0,1,2)[13]             : AIC=-8.531, Time=0.78 sec
 ARIMA(1,2,2)(1,1,0)[13]             : AIC=-10.609, Time=0.22 sec
 ARIMA(1,2,2)(1,1,1)[13]             : AIC=-8.465, Time=0.42 sec
 ARIMA(1,2,2)(2,1,0)[13]             : AIC=-8.392, Time=0.47 sec
 ARIMA(1,2,3)(0,1,0)[13]             : AIC=-10.606, Time=0.15 sec
 ARIMA(1,2,3)(0,1,1)[13]             : AIC=-8.568, Time=0.28 sec
 ARIMA(1,2,3)(1,1,0)[13]             : AIC=-8.568, Time=0.56 sec
 ARIMA(1,2,4)(0,1,0)[13]             : AIC=-8.803, Time=0.28 sec
 ARIMA(2,2,0)(0,1,0)[13]             : AIC=6.000, Time=0.02 sec
 ARIMA(2,2,0)(0,1,1)[13]             : AIC=8.000, Time=0.09 sec
 ARIMA(2,2,0)(0,1,2)[13]             : AIC=10.000, Time=0.15 sec
 ARIMA(2,2,0)(1,1,0)[13]             : AIC=8.000, Time=0.04 sec
 ARIMA(2,2,0)(1,1,1)[13]             : AIC=10.000, Time=0.07 sec
 ARIMA(2,2,0)(1,1,2)[13]             : AIC=12.000, Time=0.18 sec
 ARIMA(2,2,0)(2,1,0)[13]             : AIC=10.000, Time=0.19 sec
 ARIMA(2,2,0)(2,1,1)[13]             : AIC=12.000, Time=0.54 sec
 ARIMA(2,2,1)(0,1,0)[13]             : AIC=-12.815, Time=0.07 sec
 ARIMA(2,2,1)(0,1,1)[13]             : AIC=-10.838, Time=0.35 sec
 ARIMA(2,2,1)(0,1,2)[13]             : AIC=-8.722, Time=0.82 sec
 ARIMA(2,2,1)(1,1,0)[13]             : AIC=-10.813, Time=0.32 sec
 ARIMA(2,2,1)(1,1,1)[13]             : AIC=-8.844, Time=0.32 sec
 ARIMA(2,2,1)(2,1,0)[13]             : AIC=-8.705, Time=0.93 sec
 ARIMA(2,2,2)(0,1,0)[13]             : AIC=-10.765, Time=0.09 sec
 ARIMA(2,2,2)(0,1,1)[13]             : AIC=-8.818, Time=0.56 sec
 ARIMA(2,2,2)(1,1,0)[13]             : AIC=-9.155, Time=0.54 sec
 ARIMA(2,2,3)(0,1,0)[13]             : AIC=-8.821, Time=0.12 sec
 ARIMA(3,2,0)(0,1,0)[13]             : AIC=-13.888, Time=0.12 sec
 ARIMA(3,2,0)(0,1,1)[13]             : AIC=-11.086, Time=0.30 sec
 ARIMA(3,2,0)(0,1,2)[13]             : AIC=-9.310, Time=0.66 sec
 ARIMA(3,2,0)(1,1,0)[13]             : AIC=-10.873, Time=0.29 sec
 ARIMA(3,2,0)(1,1,1)[13]             : AIC=-9.109, Time=0.23 sec
 ARIMA(3,2,0)(2,1,0)[13]             : AIC=-9.408, Time=0.87 sec
 ARIMA(3,2,1)(0,1,0)[13]             : AIC=-10.821, Time=0.19 sec
 ARIMA(3,2,1)(0,1,1)[13]             : AIC=-8.751, Time=0.43 sec
 ARIMA(3,2,1)(1,1,0)[13]             : AIC=-8.821, Time=0.69 sec
 ARIMA(3,2,2)(0,1,0)[13]             : AIC=-8.807, Time=0.14 sec
 ARIMA(4,2,0)(0,1,0)[13]             : AIC=-11.078, Time=0.14 sec
 ARIMA(4,2,0)(0,1,1)[13]             : AIC=-9.517, Time=1.75 sec
 ARIMA(4,2,0)(1,1,0)[13]             : AIC=-9.436, Time=0.53 sec
 ARIMA(4,2,1)(0,1,0)[13]             : AIC=-8.864, Time=0.13 sec
 ARIMA(5,2,0)(0,1,0)[13]             : AIC=-9.740, Time=0.16 sec

Best model:  ARIMA(0,2,1)(0,1,0)[13]          
Total fit time: 36.303 seconds
 ARIMA(0,2,0)(0,1,0)[13]             : AIC=-114.424, Time=0.02 sec
 ARIMA(0,2,0)(0,1,1)[13]             : AIC=-113.094, Time=0.76 sec
 ARIMA(0,2,0)(0,1,2)[13]             : AIC=-111.094, Time=0.82 sec
 ARIMA(0,2,0)(1,1,0)[13]             : AIC=-113.056, Time=0.07 sec
 ARIMA(0,2,0)(1,1,1)[13]             : AIC=-111.090, Time=0.47 sec
 ARIMA(0,2,0)(1,1,2)[13]             : AIC=-109.089, Time=0.56 sec
 ARIMA(0,2,0)(2,1,0)[13]             : AIC=-111.089, Time=0.37 sec
 ARIMA(0,2,0)(2,1,1)[13]             : AIC=-109.078, Time=0.50 sec
 ARIMA(0,2,0)(2,1,2)[13]             : AIC=-107.084, Time=0.57 sec
 ARIMA(0,2,1)(0,1,0)[13]             : AIC=-131.271, Time=0.03 sec
 ARIMA(0,2,1)(0,1,1)[13]             : AIC=-129.722, Time=0.52 sec
 ARIMA(0,2,1)(0,1,2)[13]             : AIC=-127.792, Time=0.95 sec
 ARIMA(0,2,1)(1,1,0)[13]             : AIC=-129.641, Time=0.11 sec
 ARIMA(0,2,1)(1,1,1)[13]             : AIC=-127.751, Time=0.69 sec
 ARIMA(0,2,1)(1,1,2)[13]             : AIC=-125.740, Time=1.10 sec
 ARIMA(0,2,1)(2,1,0)[13]             : AIC=-127.620, Time=0.60 sec
 ARIMA(0,2,1)(2,1,1)[13]             : AIC=-125.689, Time=0.65 sec
 ARIMA(0,2,1)(2,1,2)[13]             : AIC=-123.928, Time=0.72 sec
 ARIMA(0,2,2)(0,1,0)[13]             : AIC=-134.472, Time=0.08 sec
 ARIMA(0,2,2)(0,1,1)[13]             : AIC=-132.653, Time=0.56 sec
 ARIMA(0,2,2)(0,1,2)[13]             : AIC=-130.509, Time=0.98 sec
 ARIMA(0,2,2)(1,1,0)[13]             : AIC=-132.658, Time=0.42 sec
 ARIMA(0,2,2)(1,1,1)[13]             : AIC=-130.586, Time=0.59 sec
 ARIMA(0,2,2)(1,1,2)[13]             : AIC=-128.496, Time=1.22 sec
 ARIMA(0,2,2)(2,1,0)[13]             : AIC=-130.674, Time=1.44 sec
 ARIMA(0,2,2)(2,1,1)[13]             : AIC=-128.946, Time=1.54 sec
 ARIMA(0,2,3)(0,1,0)[13]             : AIC=-132.834, Time=0.21 sec
 ARIMA(0,2,3)(0,1,1)[13]             : AIC=-130.940, Time=0.53 sec
 ARIMA(0,2,3)(0,1,2)[13]             : AIC=-128.860, Time=0.58 sec
 ARIMA(0,2,3)(1,1,0)[13]             : AIC=-131.181, Time=0.47 sec
 ARIMA(0,2,3)(1,1,1)[13]             : AIC=-128.916, Time=0.70 sec
 ARIMA(0,2,3)(2,1,0)[13]             : AIC=-128.836, Time=1.33 sec
 ARIMA(0,2,4)(0,1,0)[13]             : AIC=-130.819, Time=0.17 sec
 ARIMA(0,2,4)(0,1,1)[13]             : AIC=-129.388, Time=0.58 sec
 ARIMA(0,2,4)(1,1,0)[13]             : AIC=-129.127, Time=0.68 sec
 ARIMA(0,2,5)(0,1,0)[13]             : AIC=-129.983, Time=0.25 sec
 ARIMA(1,2,0)(0,1,0)[13]             : AIC=-123.794, Time=0.04 sec
 ARIMA(1,2,0)(0,1,1)[13]             : AIC=-121.794, Time=0.26 sec
 ARIMA(1,2,0)(0,1,2)[13]             : AIC=-120.215, Time=2.29 sec
 ARIMA(1,2,0)(1,1,0)[13]             : AIC=-122.221, Time=0.14 sec
 ARIMA(1,2,0)(1,1,1)[13]             : AIC=-120.227, Time=0.62 sec
 ARIMA(1,2,0)(1,1,2)[13]             : AIC=-118.243, Time=0.92 sec
 ARIMA(1,2,0)(2,1,0)[13]             : AIC=-120.199, Time=0.61 sec
 ARIMA(1,2,0)(2,1,1)[13]             : AIC=-118.246, Time=1.01 sec
 ARIMA(1,2,0)(2,1,2)[13]             : AIC=-116.194, Time=1.46 sec
 ARIMA(1,2,1)(0,1,0)[13]             : AIC=-133.266, Time=0.11 sec
 ARIMA(1,2,1)(0,1,1)[13]             : AIC=-131.505, Time=0.66 sec
 ARIMA(1,2,1)(0,1,2)[13]             : AIC=-128.374, Time=0.93 sec
 ARIMA(1,2,1)(1,1,0)[13]             : AIC=-130.817, Time=0.64 sec
 ARIMA(1,2,1)(1,1,1)[13]             : AIC=-128.631, Time=0.41 sec
 ARIMA(1,2,1)(1,1,2)[13]             : AIC=-126.504, Time=1.64 sec
 ARIMA(1,2,1)(2,1,0)[13]             : AIC=-128.636, Time=1.19 sec
 ARIMA(1,2,1)(2,1,1)[13]             : AIC=-126.692, Time=2.02 sec
 ARIMA(1,2,2)(0,1,0)[13]             : AIC=-129.959, Time=0.09 sec
 ARIMA(1,2,2)(0,1,1)[13]             : AIC=-128.499, Time=0.52 sec
 ARIMA(1,2,2)(0,1,2)[13]             : AIC=-125.916, Time=0.86 sec
 ARIMA(1,2,2)(1,1,0)[13]             : AIC=-128.461, Time=0.65 sec
 ARIMA(1,2,2)(1,1,1)[13]             : AIC=-121.560, Time=0.28 sec
 ARIMA(1,2,2)(2,1,0)[13]             : AIC=-126.477, Time=1.25 sec
 ARIMA(1,2,3)(0,1,0)[13]             : AIC=-130.667, Time=0.08 sec
 ARIMA(1,2,3)(0,1,1)[13]             : AIC=-128.774, Time=0.52 sec
 ARIMA(1,2,3)(1,1,0)[13]             : AIC=-128.794, Time=1.01 sec
 ARIMA(1,2,4)(0,1,0)[13]             : AIC=inf, Time=0.11 sec
 ARIMA(2,2,0)(0,1,0)[13]             : AIC=-125.953, Time=0.03 sec
 ARIMA(2,2,0)(0,1,1)[13]             : AIC=-123.966, Time=0.61 sec
 ARIMA(2,2,0)(0,1,2)[13]             : AIC=-121.953, Time=1.47 sec
 ARIMA(2,2,0)(1,1,0)[13]             : AIC=-123.816, Time=2.07 sec
 ARIMA(2,2,0)(1,1,1)[13]             : AIC=-121.953, Time=0.98 sec
 ARIMA(2,2,0)(1,1,2)[13]             : AIC=-119.953, Time=3.22 sec
 ARIMA(2,2,0)(2,1,0)[13]             : AIC=-121.953, Time=0.53 sec
 ARIMA(2,2,0)(2,1,1)[13]             : AIC=-119.953, Time=1.26 sec
 ARIMA(2,2,1)(0,1,0)[13]             : AIC=-132.152, Time=0.08 sec
 ARIMA(2,2,1)(0,1,1)[13]             : AIC=-129.972, Time=3.31 sec
 ARIMA(2,2,1)(0,1,2)[13]             : AIC=-128.023, Time=2.51 sec
 ARIMA(2,2,1)(1,1,0)[13]             : AIC=-130.183, Time=0.40 sec
 ARIMA(2,2,1)(1,1,1)[13]             : AIC=-128.201, Time=1.02 sec
 ARIMA(2,2,1)(2,1,0)[13]             : AIC=-126.871, Time=0.46 sec
 ARIMA(2,2,2)(0,1,0)[13]             : AIC=-130.671, Time=0.08 sec
 ARIMA(2,2,2)(0,1,1)[13]             : AIC=-128.688, Time=0.53 sec
 ARIMA(2,2,2)(1,1,0)[13]             : AIC=-128.737, Time=1.06 sec
 ARIMA(2,2,3)(0,1,0)[13]             : AIC=inf, Time=0.19 sec
 ARIMA(3,2,0)(0,1,0)[13]             : AIC=-127.226, Time=0.11 sec
 ARIMA(3,2,0)(0,1,1)[13]             : AIC=-127.335, Time=0.57 sec
 ARIMA(3,2,0)(0,1,2)[13]             : AIC=-125.091, Time=1.87 sec
 ARIMA(3,2,0)(1,1,0)[13]             : AIC=-126.409, Time=3.26 sec
 ARIMA(3,2,0)(1,1,1)[13]             : AIC=-125.363, Time=3.82 sec
 ARIMA(3,2,0)(2,1,0)[13]             : AIC=-125.210, Time=6.64 sec
 ARIMA(3,2,1)(0,1,0)[13]             : AIC=-130.588, Time=0.15 sec
 ARIMA(3,2,1)(0,1,1)[13]             : AIC=-129.615, Time=2.14 sec
 ARIMA(3,2,1)(1,1,0)[13]             : AIC=-129.548, Time=3.02 sec
 ARIMA(3,2,2)(0,1,0)[13]             : AIC=-127.417, Time=0.13 sec
 ARIMA(4,2,0)(0,1,0)[13]             : AIC=-131.461, Time=0.22 sec
 ARIMA(4,2,0)(0,1,1)[13]             : AIC=-129.389, Time=4.06 sec
 ARIMA(4,2,0)(1,1,0)[13]             : AIC=-129.191, Time=3.16 sec
 ARIMA(4,2,1)(0,1,0)[13]             : AIC=-130.626, Time=0.20 sec
 ARIMA(5,2,0)(0,1,0)[13]             : AIC=-130.894, Time=0.19 sec

Best model:  ARIMA(0,2,2)(0,1,0)[13]          
Total fit time: 91.556 seconds
 ARIMA(0,2,0)(0,1,0)[13]             : AIC=-226.307, Time=0.01 sec
 ARIMA(0,2,0)(0,1,1)[13]             : AIC=-233.499, Time=1.47 sec
 ARIMA(0,2,0)(0,1,2)[13]             : AIC=-231.350, Time=4.19 sec
 ARIMA(0,2,0)(1,1,0)[13]             : AIC=-231.273, Time=0.36 sec
 ARIMA(0,2,0)(1,1,1)[13]             : AIC=-231.313, Time=1.47 sec
 ARIMA(0,2,0)(1,1,2)[13]             : AIC=-229.245, Time=2.23 sec
 ARIMA(0,2,0)(2,1,0)[13]             : AIC=-224.293, Time=2.14 sec
 ARIMA(0,2,0)(2,1,1)[13]             : AIC=-229.718, Time=1.27 sec
 ARIMA(0,2,0)(2,1,2)[13]             : AIC=-227.404, Time=1.05 sec
 ARIMA(0,2,1)(0,1,0)[13]             : AIC=-263.155, Time=0.10 sec
 ARIMA(0,2,1)(0,1,1)[13]             : AIC=-267.676, Time=0.45 sec
 ARIMA(0,2,1)(0,1,2)[13]             : AIC=-265.676, Time=0.72 sec
 ARIMA(0,2,1)(1,1,0)[13]             : AIC=-266.617, Time=0.15 sec
 ARIMA(0,2,1)(1,1,1)[13]             : AIC=-265.686, Time=0.33 sec
 ARIMA(0,2,1)(1,1,2)[13]             : AIC=-263.767, Time=0.79 sec
 ARIMA(0,2,1)(2,1,0)[13]             : AIC=-256.768, Time=0.40 sec
 ARIMA(0,2,1)(2,1,1)[13]             : AIC=-263.163, Time=0.91 sec
 ARIMA(0,2,1)(2,1,2)[13]             : AIC=-261.606, Time=1.78 sec
 ARIMA(0,2,2)(0,1,0)[13]             : AIC=-270.797, Time=0.08 sec
 ARIMA(0,2,2)(0,1,1)[13]             : AIC=-270.761, Time=0.55 sec
 ARIMA(0,2,2)(0,1,2)[13]             : AIC=-269.025, Time=0.77 sec
 ARIMA(0,2,2)(1,1,0)[13]             : AIC=-267.546, Time=0.53 sec
 ARIMA(0,2,2)(1,1,1)[13]             : AIC=-270.245, Time=1.30 sec
 ARIMA(0,2,2)(1,1,2)[13]             : AIC=-264.239, Time=1.45 sec
 ARIMA(0,2,2)(2,1,0)[13]             : AIC=-270.073, Time=1.19 sec
 ARIMA(0,2,2)(2,1,1)[13]             : AIC=-267.090, Time=1.86 sec
 ARIMA(0,2,3)(0,1,0)[13]             : AIC=-268.956, Time=0.14 sec
 ARIMA(0,2,3)(0,1,1)[13]             : AIC=-270.872, Time=1.39 sec
 ARIMA(0,2,3)(0,1,2)[13]             : AIC=-268.955, Time=1.19 sec
 ARIMA(0,2,3)(1,1,0)[13]             : AIC=-270.857, Time=1.11 sec
 ARIMA(0,2,3)(1,1,1)[13]             : AIC=-269.163, Time=1.08 sec
 ARIMA(0,2,3)(2,1,0)[13]             : AIC=-258.897, Time=2.27 sec
 ARIMA(0,2,4)(0,1,0)[13]             : AIC=-267.253, Time=0.18 sec
 ARIMA(0,2,4)(0,1,1)[13]             : AIC=-267.882, Time=0.87 sec
 ARIMA(0,2,4)(1,1,0)[13]             : AIC=-268.632, Time=0.54 sec
 ARIMA(0,2,5)(0,1,0)[13]             : AIC=-264.341, Time=0.28 sec
 ARIMA(1,2,0)(0,1,0)[13]             : AIC=-246.654, Time=0.03 sec
 ARIMA(1,2,0)(0,1,1)[13]             : AIC=-250.117, Time=1.18 sec
 ARIMA(1,2,0)(0,1,2)[13]             : AIC=-249.068, Time=1.88 sec
 ARIMA(1,2,0)(1,1,0)[13]             : AIC=-250.974, Time=1.15 sec
 ARIMA(1,2,0)(1,1,1)[13]             : AIC=-249.628, Time=1.14 sec
 ARIMA(1,2,0)(1,1,2)[13]             : AIC=-247.735, Time=1.64 sec
 ARIMA(1,2,0)(2,1,0)[13]             : AIC=-241.107, Time=1.33 sec
 ARIMA(1,2,0)(2,1,1)[13]             : AIC=-246.376, Time=0.78 sec
 ARIMA(1,2,0)(2,1,2)[13]             : AIC=-245.587, Time=1.73 sec
 ARIMA(1,2,1)(0,1,0)[13]             : AIC=-264.642, Time=0.07 sec
 ARIMA(1,2,1)(0,1,1)[13]             : AIC=-268.078, Time=0.50 sec
 ARIMA(1,2,1)(0,1,2)[13]             : AIC=-266.250, Time=1.16 sec
 ARIMA(1,2,1)(1,1,0)[13]             : AIC=-268.255, Time=0.47 sec
 ARIMA(1,2,1)(1,1,1)[13]             : AIC=-265.149, Time=0.19 sec
 ARIMA(1,2,1)(1,1,2)[13]             : AIC=-262.924, Time=1.01 sec
 ARIMA(1,2,1)(2,1,0)[13]             : AIC=-265.580, Time=1.52 sec
 ARIMA(1,2,1)(2,1,1)[13]             : AIC=-263.516, Time=2.15 sec
 ARIMA(1,2,2)(0,1,0)[13]             : AIC=-262.732, Time=0.24 sec
 ARIMA(1,2,2)(0,1,1)[13]             : AIC=-265.399, Time=0.51 sec
 ARIMA(1,2,2)(0,1,2)[13]             : AIC=-264.121, Time=1.47 sec
 ARIMA(1,2,2)(1,1,0)[13]             : AIC=-257.338, Time=0.20 sec
 ARIMA(1,2,2)(1,1,1)[13]             : AIC=-264.968, Time=2.02 sec
 ARIMA(1,2,2)(2,1,0)[13]             : AIC=-257.810, Time=1.13 sec
 ARIMA(1,2,3)(0,1,0)[13]             : AIC=-266.705, Time=0.38 sec
 ARIMA(1,2,3)(0,1,1)[13]             : AIC=-268.451, Time=0.54 sec
 ARIMA(1,2,3)(1,1,0)[13]             : AIC=-268.664, Time=0.27 sec
 ARIMA(1,2,4)(0,1,0)[13]             : AIC=-264.930, Time=0.30 sec
 ARIMA(2,2,0)(0,1,0)[13]             : AIC=-253.562, Time=0.06 sec
 ARIMA(2,2,0)(0,1,1)[13]             : AIC=-254.010, Time=0.89 sec
 ARIMA(2,2,0)(0,1,2)[13]             : AIC=-251.591, Time=1.53 sec
 ARIMA(2,2,0)(1,1,0)[13]             : AIC=-253.323, Time=0.07 sec
 ARIMA(2,2,0)(1,1,1)[13]             : AIC=-251.962, Time=0.92 sec
 ARIMA(2,2,0)(1,1,2)[13]             : AIC=-249.893, Time=1.37 sec
 ARIMA(2,2,0)(2,1,0)[13]             : AIC=-245.115, Time=1.31 sec
 ARIMA(2,2,0)(2,1,1)[13]             : AIC=-249.924, Time=1.27 sec
 ARIMA(2,2,1)(0,1,0)[13]             : AIC=-266.368, Time=0.09 sec
 ARIMA(2,2,1)(0,1,1)[13]             : AIC=-267.486, Time=0.17 sec
 ARIMA(2,2,1)(0,1,2)[13]             : AIC=-265.545, Time=1.61 sec
 ARIMA(2,2,1)(1,1,0)[13]             : AIC=-267.740, Time=0.57 sec
 ARIMA(2,2,1)(1,1,1)[13]             : AIC=-266.349, Time=0.58 sec
 ARIMA(2,2,1)(2,1,0)[13]             : AIC=-261.507, Time=1.33 sec
 ARIMA(2,2,2)(0,1,0)[13]             : AIC=-261.269, Time=0.14 sec
 ARIMA(2,2,2)(0,1,1)[13]             : AIC=-266.250, Time=0.78 sec
 ARIMA(2,2,2)(1,1,0)[13]             : AIC=-257.522, Time=0.77 sec
 ARIMA(2,2,3)(0,1,0)[13]             : AIC=-263.993, Time=0.17 sec
 ARIMA(3,2,0)(0,1,0)[13]             : AIC=-257.739, Time=0.14 sec
 ARIMA(3,2,0)(0,1,1)[13]             : AIC=-262.913, Time=2.42 sec
 ARIMA(3,2,0)(0,1,2)[13]             : AIC=-264.726, Time=1.16 sec
 ARIMA(3,2,0)(1,1,0)[13]             : AIC=-268.444, Time=0.65 sec
 ARIMA(3,2,0)(1,1,1)[13]             : AIC=-265.745, Time=0.64 sec
 ARIMA(3,2,0)(2,1,0)[13]             : AIC=-267.353, Time=1.63 sec
 ARIMA(3,2,1)(0,1,0)[13]             : AIC=-266.467, Time=0.17 sec
 ARIMA(3,2,1)(0,1,1)[13]             : AIC=-270.530, Time=0.45 sec
 ARIMA(3,2,1)(1,1,0)[13]             : AIC=-272.865, Time=0.60 sec
 ARIMA(3,2,2)(0,1,0)[13]             : AIC=-263.301, Time=0.13 sec
 ARIMA(4,2,0)(0,1,0)[13]             : AIC=-263.515, Time=0.19 sec
 ARIMA(4,2,0)(0,1,1)[13]             : AIC=-267.314, Time=0.49 sec
 ARIMA(4,2,0)(1,1,0)[13]             : AIC=-268.443, Time=0.38 sec
 ARIMA(4,2,1)(0,1,0)[13]             : AIC=-266.387, Time=0.22 sec
 ARIMA(5,2,0)(0,1,0)[13]             : AIC=-266.097, Time=0.18 sec

Best model:  ARIMA(3,2,1)(1,1,0)[13]          
Total fit time: 84.726 seconds
Average RMSE from Time Series Cross-Validation: 0.020359403573376327

Through auto_arima, the parameters that achieved the best results in terms of RMSE are ARIMA(5,2,0)(0,1,0)[24]. The meanings of these parameters are as follows:

Non-seasonal

5 (p): The model uses the past five observations to predict the current value (number of autoregressive terms).

2 (d): The data has been differenced twice to make it stationary (the degree of differencing).

0 (q): The model does not use past forecast errors in predicting future values (number of moving average terms).

Seasonal

0 (P): The model does not use past seasonal observations in predicting the current value (number of seasonal autoregressive terms).

1 (D): Data are seasonally differenced once (degree of seasonal differencing).

0 (Q): The model does not use past seasonal forecast errors to predict future values (number of seasonal moving average terms).

1.3.2.3 3. Model Performance

As far as how this model compares to the manual ARIMA model I created, it has returned a different set of best parameters. ARIMA’s was (2,2,6) with no seasonality and that returned a test RMSE of 0.0016051827138580381 vs. the best auto_arima model which had a test RMSE of 0.0035731612930503405. In summary, the key difference lies in the seasonal component of ARIMA(5,2,0)(0,1,0)24, making it suitable for seasonal data, whereas ARIMA(2,2,6) is a non-seasonal model with a focus on capturing autocorrelation in the error terms over a longer lag period.

Below are the results of the best auto_arima model I could create. The test RMSE is 0.0035731612930503405, among the lowest of the models I have created. The train RMSE of 0.016412036571477613 is pretty on par with the other model variations. Examining the residual plot, despite large dips in the beginning, the residuals appear to hover around zero and the variance remains fairly consistent, suggesting the final model does not systematically over or underestimate the observed values. Furthermore, I do not see any patterns nor outliers.

As for other model statistics, the high log likelihood, and low AIC, BIC, p-values, and sigma2 suggests that the model fits the data well without being overly complex, the AR terms are relevant, and little unexplained variation among other things. Furthermore, there appears to be no significant autocorrelation and the residuals normally distributed based on the Ljung-Box and Jarque-Bera tests. However, there is a slight skew and high kurtosis which may suggest some deviations. Furthermore, there is evidence of heteroskedasticity indicating the variance of residuals varies over time.

Overall, I would say that this model performs relatively well despite some evidence of heteroskedasticity and the unusual nature of the train and test RMSEs.

Code
final_model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=24,
                        start_P=0, seasonal=True,
                        d=2, D = 1, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

# Residual Analysis
residuals = pd.Series(final_model.arima_res_.resid)
plt.figure(figsize=(12, 6))
plt.subplot(211)
plot_acf(residuals, ax=plt.gca())
plt.subplot(212)
plot_pacf(residuals, ax=plt.gca())
plt.show()

# Check if residuals have any patterns left
plt.figure()
residuals.plot(title="Residuals")
plt.show()

# Print final model summary
final_model.summary()
 ARIMA(0,2,0)(0,1,0)[24]             : AIC=-166.041, Time=0.10 sec
 ARIMA(0,2,0)(0,1,1)[24]             : AIC=-164.041, Time=0.41 sec
 ARIMA(0,2,0)(0,1,2)[24]             : AIC=-162.041, Time=1.28 sec
 ARIMA(0,2,0)(1,1,0)[24]             : AIC=-164.053, Time=0.45 sec
 ARIMA(0,2,0)(1,1,1)[24]             : AIC=-162.041, Time=1.05 sec
 ARIMA(0,2,0)(1,1,2)[24]             : AIC=-160.041, Time=2.48 sec
 ARIMA(0,2,0)(2,1,0)[24]             : AIC=-162.041, Time=0.89 sec
 ARIMA(0,2,0)(2,1,1)[24]             : AIC=-160.041, Time=2.21 sec
 ARIMA(0,2,0)(2,1,2)[24]             : AIC=-158.041, Time=2.02 sec
 ARIMA(0,2,1)(0,1,0)[24]             : AIC=-186.906, Time=0.08 sec
 ARIMA(0,2,1)(0,1,1)[24]             : AIC=-184.906, Time=0.46 sec
 ARIMA(0,2,1)(0,1,2)[24]             : AIC=-182.906, Time=1.74 sec
 ARIMA(0,2,1)(1,1,0)[24]             : AIC=-184.925, Time=0.84 sec
 ARIMA(0,2,1)(1,1,1)[24]             : AIC=-184.796, Time=1.70 sec
 ARIMA(0,2,1)(1,1,2)[24]             : AIC=-180.906, Time=1.80 sec
 ARIMA(0,2,1)(2,1,0)[24]             : AIC=-182.988, Time=5.66 sec
 ARIMA(0,2,1)(2,1,1)[24]             : AIC=-180.906, Time=2.15 sec
 ARIMA(0,2,1)(2,1,2)[24]             : AIC=-178.906, Time=2.77 sec
 ARIMA(0,2,2)(0,1,0)[24]             : AIC=-190.267, Time=0.20 sec
 ARIMA(0,2,2)(0,1,1)[24]             : AIC=-187.525, Time=1.37 sec
 ARIMA(0,2,2)(0,1,2)[24]             : AIC=-187.335, Time=6.90 sec
 ARIMA(0,2,2)(1,1,0)[24]             : AIC=-189.053, Time=1.22 sec
 ARIMA(0,2,2)(1,1,1)[24]             : AIC=-185.601, Time=1.95 sec
 ARIMA(0,2,2)(1,1,2)[24]             : AIC=-184.499, Time=6.34 sec
 ARIMA(0,2,2)(2,1,0)[24]             : AIC=-184.362, Time=2.99 sec
 ARIMA(0,2,2)(2,1,1)[24]             : AIC=-183.755, Time=5.39 sec
 ARIMA(0,2,3)(0,1,0)[24]             : AIC=-187.669, Time=0.26 sec
 ARIMA(0,2,3)(0,1,1)[24]             : AIC=-186.244, Time=1.56 sec
 ARIMA(0,2,3)(0,1,2)[24]             : AIC=-185.166, Time=6.32 sec
 ARIMA(0,2,3)(1,1,0)[24]             : AIC=-186.478, Time=1.41 sec
 ARIMA(0,2,3)(1,1,1)[24]             : AIC=-184.523, Time=3.57 sec
 ARIMA(0,2,3)(2,1,0)[24]             : AIC=-184.598, Time=6.16 sec
 ARIMA(0,2,4)(0,1,0)[24]             : AIC=-179.043, Time=0.45 sec
 ARIMA(0,2,4)(0,1,1)[24]             : AIC=-182.627, Time=3.94 sec
 ARIMA(0,2,4)(1,1,0)[24]             : AIC=-182.035, Time=1.91 sec
 ARIMA(0,2,5)(0,1,0)[24]             : AIC=-186.193, Time=0.51 sec
 ARIMA(1,2,0)(0,1,0)[24]             : AIC=-181.527, Time=0.04 sec
 ARIMA(1,2,0)(0,1,1)[24]             : AIC=-179.527, Time=0.40 sec
 ARIMA(1,2,0)(0,1,2)[24]             : AIC=-177.527, Time=2.12 sec
 ARIMA(1,2,0)(1,1,0)[24]             : AIC=-179.519, Time=0.40 sec
 ARIMA(1,2,0)(1,1,1)[24]             : AIC=-177.527, Time=0.69 sec
 ARIMA(1,2,0)(1,1,2)[24]             : AIC=-175.527, Time=0.88 sec
 ARIMA(1,2,0)(2,1,0)[24]             : AIC=-177.527, Time=2.35 sec
 ARIMA(1,2,0)(2,1,1)[24]             : AIC=-175.527, Time=1.07 sec
 ARIMA(1,2,0)(2,1,2)[24]             : AIC=-173.527, Time=1.70 sec
 ARIMA(1,2,1)(0,1,0)[24]             : AIC=-187.721, Time=0.25 sec
 ARIMA(1,2,1)(0,1,1)[24]             : AIC=-186.257, Time=1.34 sec
 ARIMA(1,2,1)(0,1,2)[24]             : AIC=inf, Time=5.11 sec
 ARIMA(1,2,1)(1,1,0)[24]             : AIC=-186.185, Time=1.19 sec
 ARIMA(1,2,1)(1,1,1)[24]             : AIC=-184.344, Time=1.58 sec
 ARIMA(1,2,1)(1,1,2)[24]             : AIC=-183.749, Time=6.44 sec
 ARIMA(1,2,1)(2,1,0)[24]             : AIC=-186.561, Time=5.75 sec
 ARIMA(1,2,1)(2,1,1)[24]             : AIC=-183.211, Time=6.42 sec
 ARIMA(1,2,2)(0,1,0)[24]             : AIC=-190.708, Time=0.29 sec
 ARIMA(1,2,2)(0,1,1)[24]             : AIC=-187.757, Time=2.09 sec
 ARIMA(1,2,2)(0,1,2)[24]             : AIC=-183.763, Time=3.43 sec
 ARIMA(1,2,2)(1,1,0)[24]             : AIC=-187.495, Time=1.78 sec
 ARIMA(1,2,2)(1,1,1)[24]             : AIC=-185.842, Time=1.51 sec
 ARIMA(1,2,2)(2,1,0)[24]             : AIC=-186.618, Time=4.94 sec
 ARIMA(1,2,3)(0,1,0)[24]             : AIC=-187.480, Time=0.35 sec
 ARIMA(1,2,3)(0,1,1)[24]             : AIC=-183.869, Time=1.99 sec
 ARIMA(1,2,3)(1,1,0)[24]             : AIC=-184.631, Time=1.57 sec
 ARIMA(1,2,4)(0,1,0)[24]             : AIC=-190.527, Time=0.58 sec
 ARIMA(2,2,0)(0,1,0)[24]             : AIC=-181.537, Time=0.08 sec
 ARIMA(2,2,0)(0,1,1)[24]             : AIC=-179.537, Time=0.48 sec
 ARIMA(2,2,0)(0,1,2)[24]             : AIC=-177.537, Time=1.82 sec
 ARIMA(2,2,0)(1,1,0)[24]             : AIC=-179.544, Time=0.84 sec
 ARIMA(2,2,0)(1,1,1)[24]             : AIC=-177.537, Time=0.73 sec
 ARIMA(2,2,0)(1,1,2)[24]             : AIC=-175.537, Time=2.24 sec
 ARIMA(2,2,0)(2,1,0)[24]             : AIC=-177.537, Time=1.62 sec
 ARIMA(2,2,0)(2,1,1)[24]             : AIC=-175.537, Time=2.85 sec
 ARIMA(2,2,1)(0,1,0)[24]             : AIC=-185.283, Time=0.26 sec
 ARIMA(2,2,1)(0,1,1)[24]             : AIC=-181.486, Time=1.45 sec
 ARIMA(2,2,1)(0,1,2)[24]             : AIC=-183.570, Time=6.13 sec
 ARIMA(2,2,1)(1,1,0)[24]             : AIC=-182.502, Time=1.86 sec
 ARIMA(2,2,1)(1,1,1)[24]             : AIC=-183.040, Time=2.05 sec
 ARIMA(2,2,1)(2,1,0)[24]             : AIC=-184.493, Time=4.84 sec
 ARIMA(2,2,2)(0,1,0)[24]             : AIC=-188.317, Time=0.44 sec
 ARIMA(2,2,2)(0,1,1)[24]             : AIC=inf, Time=2.29 sec
 ARIMA(2,2,2)(1,1,0)[24]             : AIC=-185.590, Time=2.62 sec
 ARIMA(2,2,3)(0,1,0)[24]             : AIC=-183.145, Time=0.50 sec
 ARIMA(3,2,0)(0,1,0)[24]             : AIC=-183.598, Time=0.20 sec
 ARIMA(3,2,0)(0,1,1)[24]             : AIC=-182.122, Time=1.70 sec
 ARIMA(3,2,0)(0,1,2)[24]             : AIC=-180.938, Time=2.28 sec
 ARIMA(3,2,0)(1,1,0)[24]             : AIC=-183.052, Time=1.24 sec
 ARIMA(3,2,0)(1,1,1)[24]             : AIC=-180.041, Time=1.55 sec
 ARIMA(3,2,0)(2,1,0)[24]             : AIC=-180.685, Time=2.92 sec
 ARIMA(3,2,1)(0,1,0)[24]             : AIC=-188.882, Time=0.36 sec
 ARIMA(3,2,1)(0,1,1)[24]             : AIC=-186.530, Time=2.34 sec
 ARIMA(3,2,1)(1,1,0)[24]             : AIC=-186.681, Time=2.61 sec
 ARIMA(3,2,2)(0,1,0)[24]             : AIC=-188.522, Time=0.48 sec
 ARIMA(4,2,0)(0,1,0)[24]             : AIC=-184.556, Time=0.31 sec
 ARIMA(4,2,0)(0,1,1)[24]             : AIC=-181.657, Time=1.23 sec
 ARIMA(4,2,0)(1,1,0)[24]             : AIC=-181.091, Time=1.80 sec
 ARIMA(4,2,1)(0,1,0)[24]             : AIC=-187.470, Time=0.60 sec
 ARIMA(5,2,0)(0,1,0)[24]             : AIC=-196.056, Time=0.41 sec

Best model:  ARIMA(5,2,0)(0,1,0)[24]          
Total fit time: 189.945 seconds

SARIMAX Results
Dep. Variable: y No. Observations: 56
Model: SARIMAX(5, 2, 0)x(0, 1, 0, 24) Log Likelihood 104.028
Date: Fri, 24 Nov 2023 AIC -196.056
Time: 15:29:44 BIC -187.649
Sample: 11-10-2021 HQIC -193.367
- 11-30-2022
Covariance Type: opg
coef std err z P>|z| [0.025 0.975]
ar.L1 -1.1200 0.140 -7.988 0.000 -1.395 -0.845
ar.L2 -1.0810 0.186 -5.814 0.000 -1.445 -0.717
ar.L3 -1.0802 0.212 -5.100 0.000 -1.495 -0.665
ar.L4 -0.8488 0.200 -4.234 0.000 -1.242 -0.456
ar.L5 -0.5486 0.147 -3.742 0.000 -0.836 -0.261
sigma2 5.083e-05 1.41e-05 3.605 0.000 2.32e-05 7.85e-05
Ljung-Box (L1) (Q): 0.02 Jarque-Bera (JB): 4.12
Prob(Q): 0.88 Prob(JB): 0.13
Heteroskedasticity (H): 0.05 Skew: -0.54
Prob(H) (two-sided): 0.00 Kurtosis: 4.45


Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Code
# Train results
train_pred = final_model.predict_in_sample()
pd.concat([train_aar, pd.Series(train_pred, index=train.index)], axis=1).plot(figsize=(20,8))
plt.legend(['train', 'train_pred'])

# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = final_model.predict(n_periods=len(test_aar))
pd.concat([test_aar, pd.Series(test_pred)], axis=1).plot(figsize=(20,8))
plt.legend(['test', 'test_pred'])

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")
Train RMSE: 0.016412036571477613
Test RMSE: 0.0035731612930503405

1.3.3 C. Prophet (Univariate) Model

1.3.3.1 1. Data Preparation:

The Prophet model forecasts time series data using an additive approach. It’s particularly effective with data showing strong seasonal effects and handles inconsistencies like missing values and outliers well. Prophet’s model comprises three main components: trend (\(g(t)\)), seasonality (\(s(t)\)), and holidays (\(h(t)\)), along with an error term (\(e_t\)). The trend component adapts to changes in data, seasonality uses a Fourier Series to capture cyclical patterns, and the holiday component accounts for periodic events’ impacts.

Key parameters of Prophet include:

  • growth: Specifies the trend type (linear or logistic).
  • changepoint_num: Sets the maximum number of trend changepoints.
  • changepoint_range: Determines how close changepoints can be to the end of the series, affecting model flexibility.
  • Seasonality Settings:
    • Yearly (seasonality_yearly)
    • Weekly (seasonality_weekly)
    • Daily (seasonality_daily)
  • season: Defines the seasonality type (additive or multiplicative).
  • Prior Scale Parameters: These control the flexibility of changepoints (changepoint_prior_scale), seasonality (seasonality_prior_scale), and holidays (holidays_prior_scale).

For the univariate Prophet model, I prepared the data by importing the Date and response variable 'Additional_Doses_Vax_Pct' from my dataset. The data was grouped by Date to ensure one unique value per date. The DataFrame was structured with ds for dates (in YYYY-MM-DD format) and y for the response variable. Additionally, I scaled the data for consistency with other models in the analysis.

Code
# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Import data with specific columns
df_p = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime and set as index
df_p['Date'] = pd.to_datetime(df_p['Date'])
df_p.set_index('Date', inplace=True)

# Group by 'Date' to ensure there is one unique value per date
df_p = df_p.groupby('Date').mean()

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_p[pred_var] = scaler.fit_transform(df_p[[pred_var]])

# 'Date' column as a separate variable
df_p.reset_index(inplace=True)

# Rename the columns for compatibility with Prophet
df_p.rename(columns={'Date': 'ds', pred_var: 'y'}, inplace=True)

1.3.3.2 2. Model Building:

As for the training for the Prophet univariate model, I first split my dataframe into train and test sets with a 70-30 train-test split. Then, for an initial base model, I simply fit the Prophet() model without modifying any of the parameters. The RMSE was relatively high, so I knew I could improve on my model.

Code
# Calculate the index for the 70-30 split
split_index = int(len(df_p) * 0.7)

# Split into train and test
train = df_p.iloc[:split_index]
test = df_p.iloc[split_index:]

# Initialize and fit the Prophet model on the training data
model = Prophet()
model.fit(train)
03:03:53 - cmdstanpy - INFO - Chain [1] start processing
03:03:53 - cmdstanpy - INFO - Chain [1] done processing
<prophet.forecaster.Prophet at 0x3059a6290>
Code
# Make predictions on the training set
train_pred = model.predict(train[['ds']])

# Plot the training predictions
pd.concat([train['y'], train_pred['yhat']], axis=1).plot(figsize=(15,5))
plt.legend(['train', 'train_pred'])

# Make predictions on the test set
test_pred = model.predict(test[['ds']])

# Plot the test predictions
pd.concat([test['y'], test_pred['yhat']], axis=1).plot()
plt.legend(['test', 'test_pred'])
plt.show()
# Calculate RMSE for the training set
train_rmse = sqrt(mean_squared_error(train['y'], train_pred['yhat']))
print(f"Train RMSE: {train_rmse}")

# Calculate RMSE for the test set
test_rmse = sqrt(mean_squared_error(test['y'], test_pred['yhat']))
print(f"Test RMSE: {test_rmse}")

Train RMSE: 0.002906993025481394
Test RMSE: 0.022970901026062914

Next, I enhanced the Prophet model by adding cross-validation and incorporating U.S. holidays. This approach allows the model to account for the potential impact of holidays on vaccination trends. The model fitting process remained similar, but I now generated future data points for predictions, with a weekly frequency (freq = 'W'), to align with our data’s weekly reporting structure.

For cross-validation, I set specific parameters based on the data span (November 2021 to May 2023):

  • Initial Training Period (initial): Set to ‘180 days’, giving the model a substantial initial dataset to understand any half-yearly seasonality.
  • Update Frequency (period): Chosen as ‘45 days’, ensuring the model updates itself every month and a half to stay aligned with changing data patterns.
  • Forecast Horizon (horizon): Fixed at ‘45 days’, balancing the need for near-future predictions while maintaining reasonable forecast accuracy.

These settings allowed me to evaluate the model’s performance across various simulated scenarios. Additionally, I graphically analyzed the model’s forecasts to understand how it interprets trends and seasonality.

The visual outputs indicated a consistent upward trend, aligning with the increasing cumulative nature of vaccination rates. Significantly, the model successfully captured the pronounced effects of holidays in late 2022 and early 2023 on vaccination rates.

Code
# Initialize Prophet model with US holidays
model = Prophet()
model.add_country_holidays(country_name='US')

# Fit model on the training data
model.fit(train)

# Predict on the test set with weekly frequency
future_test = model.make_future_dataframe(periods=len(test), include_history=False, freq='W')
forecast_test = model.predict(future_test)

# Calculate RMSE for the test set
test_rmse = sqrt(mean_squared_error(test['y'], forecast_test['yhat']))
print(f'Test RMSE: {test_rmse}')

# Cross-validation using training data 
cv_results = cross_validation(model, initial='180 days', period='45 days', horizon='45 days')

# Calculate RMSE for cross-validation results
rmse_cv = sqrt(mean_squared_error(cv_results['y'], cv_results['yhat']))
print(f'Cross-Validation RMSE: {rmse_cv}')

# Plot the forecast on test data
fig = model.plot(forecast_test)
plt.show()

# Plot components
fig2 = model.plot_components(forecast_test)
plt.show()
03:03:58 - cmdstanpy - INFO - Chain [1] start processing
03:03:58 - cmdstanpy - INFO - Chain [1] done processing
Test RMSE: 0.021909128419629015
03:03:58 - cmdstanpy - INFO - Chain [1] start processing
03:03:58 - cmdstanpy - INFO - Chain [1] done processing
03:03:58 - cmdstanpy - INFO - Chain [1] start processing
03:03:58 - cmdstanpy - INFO - Chain [1] done processing
03:03:58 - cmdstanpy - INFO - Chain [1] start processing
03:03:58 - cmdstanpy - INFO - Chain [1] done processing
03:03:58 - cmdstanpy - INFO - Chain [1] start processing
03:03:58 - cmdstanpy - INFO - Chain [1] done processing
Cross-Validation RMSE: 0.183403907282513

Code
# Performance metrics
df_performance = performance_metrics(cv_results)
df_performance
horizon mse rmse mae mape mdape smape coverage
0 3 days 0.012509 0.111844 0.079656 0.088319 0.088319 0.081246 0.5
1 5 days 0.014979 0.122387 0.087111 0.101335 0.101335 0.092117 0.5
2 6 days 0.027961 0.167214 0.167107 0.187790 0.187790 0.171599 0.0
3 9 days 0.028462 0.168707 0.168544 0.184210 0.184210 0.168636 0.0
4 10 days 0.015481 0.124422 0.088867 0.098091 0.098091 0.089490 0.5
5 12 days 0.019008 0.137869 0.098376 0.113740 0.113740 0.102307 0.5
6 13 days 0.034707 0.186298 0.186086 0.208382 0.208382 0.188609 0.0
7 16 days 0.034400 0.185473 0.185297 0.201857 0.201857 0.183309 0.0
8 17 days 0.018706 0.136768 0.098404 0.108072 0.108072 0.097866 0.5
9 19 days 0.023495 0.153280 0.110081 0.126442 0.126442 0.112632 0.5
10 20 days 0.042114 0.205216 0.204873 0.228547 0.228547 0.204953 0.0
11 23 days 0.041149 0.202853 0.202624 0.220171 0.220171 0.198282 0.0
12 24 days 0.022540 0.150132 0.108881 0.119155 0.119155 0.107053 0.5
13 26 days 0.028736 0.169517 0.122592 0.140073 0.140073 0.123532 0.5
14 27 days 0.050368 0.224427 0.223870 0.248898 0.248898 0.221123 0.0
15 30 days 0.048272 0.219708 0.219415 0.237676 0.237676 0.212359 0.0
16 31 days 0.026649 0.163245 0.118840 0.129571 0.129571 0.115493 0.5
17 33 days 0.030138 0.173603 0.126168 0.140747 0.140747 0.124221 0.5
18 34 days 0.054933 0.234378 0.234105 0.256388 0.256388 0.227144 0.0
19 37 days 0.056011 0.236667 0.236283 0.255186 0.255186 0.226214 0.0
20 38 days 0.031222 0.176698 0.128741 0.139942 0.139942 0.123691 0.5
21 40 days 0.036291 0.190501 0.138506 0.153971 0.153971 0.134430 0.5
22 41 days 0.064124 0.253227 0.252681 0.275732 0.275732 0.242125 0.0
23 44 days 0.063789 0.252564 0.252057 0.271108 0.271108 0.238614 0.0
24 45 days 0.035969 0.189656 0.138681 0.150154 0.150154 0.131734 0.5

To refine the model, I first introduced a ‘cap’ feature, indicating the maximum achievable saturation point. This step is crucial for models with logistic growth in Prophet, as it helps define an upper limit for predictions. Observing the vaccination rate data, which initially rises rapidly before leveling off near 100%, I set growth = 'logistic' in the model to mirror this pattern.

Like before, I included U.S. holidays to account for their impact on vaccination rates. For hyperparameter tuning, I followed Facebook Prophet’s documentation guidelines, creating a grid of recommended parameters. This grid served as a foundation for exploring various hyperparameter combinations.

In the tuning process, I fitted the model to the training data, maintaining the same initial, period, and horizon settings as before to ensure consistent cross-validation and scoring. After each iteration, performance metrics, particularly the RMSE, were calculated. This approach enabled me to identify the best-performing parameters.

For the final model evaluation, I specifically set rolling_window = 1 during cross-validation. This setting was chosen to treat each forecasted point independently, avoiding any smoothing of errors and providing a more detailed view of the model’s accuracy. The result was a clear picture of the model’s performance on the test data, reflected in the test RMSE.

Code
# Set the logistic growth
train['cap'] = 1  
test['cap'] = 1   

# Initialize and fit the Prophet model on the training data with logistic growth
model = Prophet(growth='logistic')
model.add_country_holidays(country_name='US')
model.fit(train)

# Parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.001, 0.01, 0.1, 0.5],
    'seasonality_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'holidays_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'seasonality_mode': ['additive', 'multiplicative']
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each params 

# Cross-validation to evaluate all parameters
for params in all_params:
    m = Prophet(growth='logistic', **params)
    m.add_country_holidays(country_name='US')
    m.fit(train)
    
    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params}")

# Fit the final model with the best parameters
final_model = Prophet(growth='logistic', **best_params)
final_model.add_country_holidays(country_name='US')
final_model.fit(train)

# Predict and evaluate on the test set
future_test = final_model.make_future_dataframe(periods=len(test), freq='W', include_history=False)
# Add the cap to the future dataframe
future_test['cap'] = 1
forecast_test = final_model.predict(future_test)
test_rmse = sqrt(mean_squared_error(test['y'], forecast_test['yhat']))
print(f"Test RMSE: {test_rmse}")

# Perform cross-validation
df_cv = cross_validation(final_model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')
03:04:08 - cmdstanpy - INFO - Chain [1] start processing
03:04:08 - cmdstanpy - INFO - Chain [1] done processing
03:04:08 - cmdstanpy - INFO - Chain [1] start processing
03:04:09 - cmdstanpy - INFO - Chain [1] done processing
03:04:10 - cmdstanpy - INFO - Chain [1] start processing
03:04:10 - cmdstanpy - INFO - Chain [1] start processing
03:04:10 - cmdstanpy - INFO - Chain [1] start processing
03:04:10 - cmdstanpy - INFO - Chain [1] start processing
03:04:10 - cmdstanpy - INFO - Chain [1] done processing
03:04:10 - cmdstanpy - INFO - Chain [1] done processing
03:04:10 - cmdstanpy - INFO - Chain [1] done processing
03:04:10 - cmdstanpy - INFO - Chain [1] done processing
03:04:10 - cmdstanpy - INFO - Chain [1] start processing
03:04:11 - cmdstanpy - INFO - Chain [1] done processing
03:04:12 - cmdstanpy - INFO - Chain [1] start processing
03:04:12 - cmdstanpy - INFO - Chain [1] start processing
03:04:12 - cmdstanpy - INFO - Chain [1] start processing
03:04:12 - cmdstanpy - INFO - Chain [1] start processing
03:04:12 - cmdstanpy - INFO - Chain [1] done processing
03:04:12 - cmdstanpy - INFO - Chain [1] done processing
03:04:12 - cmdstanpy - INFO - Chain [1] done processing
03:04:12 - cmdstanpy - INFO - Chain [1] done processing
03:04:12 - cmdstanpy - INFO - Chain [1] start processing
03:04:13 - cmdstanpy - INFO - Chain [1] done processing
03:04:14 - cmdstanpy - INFO - Chain [1] start processing
03:04:14 - cmdstanpy - INFO - Chain [1] start processing
03:04:14 - cmdstanpy - INFO - Chain [1] start processing
03:04:14 - cmdstanpy - INFO - Chain [1] done processing
03:04:14 - cmdstanpy - INFO - Chain [1] start processing
03:04:14 - cmdstanpy - INFO - Chain [1] done processing
03:04:14 - cmdstanpy - INFO - Chain [1] done processing
03:04:14 - cmdstanpy - INFO - Chain [1] done processing
03:04:14 - cmdstanpy - INFO - Chain [1] start processing
03:04:15 - cmdstanpy - INFO - Chain [1] done processing
03:04:16 - cmdstanpy - INFO - Chain [1] start processing
03:04:16 - cmdstanpy - INFO - Chain [1] start processing
03:04:16 - cmdstanpy - INFO - Chain [1] start processing
03:04:16 - cmdstanpy - INFO - Chain [1] start processing
03:04:16 - cmdstanpy - INFO - Chain [1] done processing
03:04:16 - cmdstanpy - INFO - Chain [1] done processing
03:04:16 - cmdstanpy - INFO - Chain [1] done processing
03:04:16 - cmdstanpy - INFO - Chain [1] done processing
03:04:16 - cmdstanpy - INFO - Chain [1] start processing
03:04:17 - cmdstanpy - INFO - Chain [1] done processing
03:04:18 - cmdstanpy - INFO - Chain [1] start processing
03:04:18 - cmdstanpy - INFO - Chain [1] start processing
03:04:18 - cmdstanpy - INFO - Chain [1] start processing
03:04:18 - cmdstanpy - INFO - Chain [1] start processing
03:04:18 - cmdstanpy - INFO - Chain [1] done processing
03:04:18 - cmdstanpy - INFO - Chain [1] done processing
03:04:18 - cmdstanpy - INFO - Chain [1] done processing
03:04:18 - cmdstanpy - INFO - Chain [1] done processing
03:04:18 - cmdstanpy - INFO - Chain [1] start processing
03:04:19 - cmdstanpy - INFO - Chain [1] done processing
03:04:20 - cmdstanpy - INFO - Chain [1] start processing
03:04:20 - cmdstanpy - INFO - Chain [1] start processing
03:04:20 - cmdstanpy - INFO - Chain [1] start processing
03:04:20 - cmdstanpy - INFO - Chain [1] start processing
03:04:20 - cmdstanpy - INFO - Chain [1] done processing
03:04:20 - cmdstanpy - INFO - Chain [1] done processing
03:04:20 - cmdstanpy - INFO - Chain [1] done processing
03:04:20 - cmdstanpy - INFO - Chain [1] done processing
03:04:20 - cmdstanpy - INFO - Chain [1] start processing
03:04:22 - cmdstanpy - INFO - Chain [1] done processing
03:04:22 - cmdstanpy - INFO - Chain [1] start processing
03:04:22 - cmdstanpy - INFO - Chain [1] start processing
03:04:22 - cmdstanpy - INFO - Chain [1] start processing
03:04:22 - cmdstanpy - INFO - Chain [1] start processing
03:04:22 - cmdstanpy - INFO - Chain [1] done processing
03:04:22 - cmdstanpy - INFO - Chain [1] done processing
03:04:22 - cmdstanpy - INFO - Chain [1] done processing
03:04:22 - cmdstanpy - INFO - Chain [1] done processing
03:04:22 - cmdstanpy - INFO - Chain [1] start processing
03:04:24 - cmdstanpy - INFO - Chain [1] done processing
03:04:24 - cmdstanpy - INFO - Chain [1] start processing
03:04:24 - cmdstanpy - INFO - Chain [1] start processing
03:04:24 - cmdstanpy - INFO - Chain [1] start processing
03:04:24 - cmdstanpy - INFO - Chain [1] start processing
03:04:24 - cmdstanpy - INFO - Chain [1] done processing
03:04:24 - cmdstanpy - INFO - Chain [1] done processing
03:04:24 - cmdstanpy - INFO - Chain [1] done processing
03:04:24 - cmdstanpy - INFO - Chain [1] done processing
03:04:25 - cmdstanpy - INFO - Chain [1] start processing
03:04:26 - cmdstanpy - INFO - Chain [1] done processing
03:04:26 - cmdstanpy - INFO - Chain [1] start processing
03:04:26 - cmdstanpy - INFO - Chain [1] start processing
03:04:26 - cmdstanpy - INFO - Chain [1] start processing
03:04:26 - cmdstanpy - INFO - Chain [1] start processing
03:04:26 - cmdstanpy - INFO - Chain [1] done processing
03:04:26 - cmdstanpy - INFO - Chain [1] done processing
03:04:26 - cmdstanpy - INFO - Chain [1] done processing
03:04:27 - cmdstanpy - INFO - Chain [1] done processing
03:04:27 - cmdstanpy - INFO - Chain [1] start processing
03:04:28 - cmdstanpy - INFO - Chain [1] done processing
03:04:28 - cmdstanpy - INFO - Chain [1] start processing
03:04:28 - cmdstanpy - INFO - Chain [1] start processing
03:04:28 - cmdstanpy - INFO - Chain [1] start processing
03:04:28 - cmdstanpy - INFO - Chain [1] start processing
03:04:28 - cmdstanpy - INFO - Chain [1] done processing
03:04:29 - cmdstanpy - INFO - Chain [1] done processing
03:04:29 - cmdstanpy - INFO - Chain [1] done processing
03:04:29 - cmdstanpy - INFO - Chain [1] done processing
03:04:29 - cmdstanpy - INFO - Chain [1] start processing
03:04:30 - cmdstanpy - INFO - Chain [1] done processing
03:04:30 - cmdstanpy - INFO - Chain [1] start processing
03:04:30 - cmdstanpy - INFO - Chain [1] start processing
03:04:30 - cmdstanpy - INFO - Chain [1] start processing
03:04:31 - cmdstanpy - INFO - Chain [1] start processing
03:04:31 - cmdstanpy - INFO - Chain [1] done processing
03:04:31 - cmdstanpy - INFO - Chain [1] done processing
03:04:31 - cmdstanpy - INFO - Chain [1] done processing
03:04:31 - cmdstanpy - INFO - Chain [1] done processing
03:04:31 - cmdstanpy - INFO - Chain [1] start processing
03:04:32 - cmdstanpy - INFO - Chain [1] done processing
03:04:33 - cmdstanpy - INFO - Chain [1] start processing
03:04:33 - cmdstanpy - INFO - Chain [1] start processing
03:04:33 - cmdstanpy - INFO - Chain [1] start processing
03:04:33 - cmdstanpy - INFO - Chain [1] done processing
03:04:33 - cmdstanpy - INFO - Chain [1] start processing
03:04:33 - cmdstanpy - INFO - Chain [1] done processing
03:04:33 - cmdstanpy - INFO - Chain [1] done processing
03:04:33 - cmdstanpy - INFO - Chain [1] done processing
03:04:33 - cmdstanpy - INFO - Chain [1] start processing
03:04:34 - cmdstanpy - INFO - Chain [1] done processing
03:04:35 - cmdstanpy - INFO - Chain [1] start processing
03:04:35 - cmdstanpy - INFO - Chain [1] start processing
03:04:35 - cmdstanpy - INFO - Chain [1] start processing
03:04:35 - cmdstanpy - INFO - Chain [1] start processing
03:04:35 - cmdstanpy - INFO - Chain [1] done processing
03:04:35 - cmdstanpy - INFO - Chain [1] done processing
03:04:35 - cmdstanpy - INFO - Chain [1] done processing
03:04:35 - cmdstanpy - INFO - Chain [1] done processing
03:04:35 - cmdstanpy - INFO - Chain [1] start processing
03:04:36 - cmdstanpy - INFO - Chain [1] done processing
03:04:37 - cmdstanpy - INFO - Chain [1] start processing
03:04:37 - cmdstanpy - INFO - Chain [1] start processing
03:04:37 - cmdstanpy - INFO - Chain [1] start processing
03:04:37 - cmdstanpy - INFO - Chain [1] start processing
03:04:37 - cmdstanpy - INFO - Chain [1] done processing
03:04:37 - cmdstanpy - INFO - Chain [1] done processing
03:04:37 - cmdstanpy - INFO - Chain [1] done processing
03:04:37 - cmdstanpy - INFO - Chain [1] done processing
03:04:37 - cmdstanpy - INFO - Chain [1] start processing
03:04:38 - cmdstanpy - INFO - Chain [1] done processing
03:04:39 - cmdstanpy - INFO - Chain [1] start processing
03:04:39 - cmdstanpy - INFO - Chain [1] start processing
03:04:39 - cmdstanpy - INFO - Chain [1] start processing
03:04:39 - cmdstanpy - INFO - Chain [1] start processing
03:04:39 - cmdstanpy - INFO - Chain [1] done processing
03:04:39 - cmdstanpy - INFO - Chain [1] done processing
03:04:39 - cmdstanpy - INFO - Chain [1] done processing
03:04:39 - cmdstanpy - INFO - Chain [1] done processing
03:04:39 - cmdstanpy - INFO - Chain [1] start processing
03:04:40 - cmdstanpy - INFO - Chain [1] done processing
03:04:41 - cmdstanpy - INFO - Chain [1] start processing
03:04:41 - cmdstanpy - INFO - Chain [1] start processing
03:04:41 - cmdstanpy - INFO - Chain [1] start processing
03:04:41 - cmdstanpy - INFO - Chain [1] start processing
03:04:41 - cmdstanpy - INFO - Chain [1] done processing
03:04:41 - cmdstanpy - INFO - Chain [1] done processing
03:04:41 - cmdstanpy - INFO - Chain [1] done processing
03:04:41 - cmdstanpy - INFO - Chain [1] done processing
03:04:41 - cmdstanpy - INFO - Chain [1] start processing
03:04:42 - cmdstanpy - INFO - Chain [1] done processing
03:04:43 - cmdstanpy - INFO - Chain [1] start processing
03:04:43 - cmdstanpy - INFO - Chain [1] start processing
03:04:43 - cmdstanpy - INFO - Chain [1] start processing
03:04:43 - cmdstanpy - INFO - Chain [1] start processing
03:04:43 - cmdstanpy - INFO - Chain [1] done processing
03:04:43 - cmdstanpy - INFO - Chain [1] done processing
03:04:43 - cmdstanpy - INFO - Chain [1] done processing
03:04:43 - cmdstanpy - INFO - Chain [1] done processing
03:04:43 - cmdstanpy - INFO - Chain [1] start processing
03:04:44 - cmdstanpy - INFO - Chain [1] done processing
03:04:45 - cmdstanpy - INFO - Chain [1] start processing
03:04:45 - cmdstanpy - INFO - Chain [1] start processing
03:04:45 - cmdstanpy - INFO - Chain [1] start processing
03:04:45 - cmdstanpy - INFO - Chain [1] start processing
03:04:45 - cmdstanpy - INFO - Chain [1] done processing
03:04:45 - cmdstanpy - INFO - Chain [1] done processing
03:04:45 - cmdstanpy - INFO - Chain [1] done processing
03:04:45 - cmdstanpy - INFO - Chain [1] done processing
03:04:45 - cmdstanpy - INFO - Chain [1] start processing
03:04:46 - cmdstanpy - INFO - Chain [1] done processing
03:04:47 - cmdstanpy - INFO - Chain [1] start processing
03:04:47 - cmdstanpy - INFO - Chain [1] start processing
03:04:47 - cmdstanpy - INFO - Chain [1] start processing
03:04:47 - cmdstanpy - INFO - Chain [1] start processing
03:04:47 - cmdstanpy - INFO - Chain [1] done processing
03:04:47 - cmdstanpy - INFO - Chain [1] done processing
03:04:47 - cmdstanpy - INFO - Chain [1] done processing
03:04:47 - cmdstanpy - INFO - Chain [1] done processing
03:04:47 - cmdstanpy - INFO - Chain [1] start processing
03:04:48 - cmdstanpy - INFO - Chain [1] done processing
03:04:49 - cmdstanpy - INFO - Chain [1] start processing
03:04:49 - cmdstanpy - INFO - Chain [1] start processing
03:04:49 - cmdstanpy - INFO - Chain [1] start processing
03:04:49 - cmdstanpy - INFO - Chain [1] start processing
03:04:49 - cmdstanpy - INFO - Chain [1] done processing
03:04:49 - cmdstanpy - INFO - Chain [1] done processing
03:04:49 - cmdstanpy - INFO - Chain [1] done processing
03:04:49 - cmdstanpy - INFO - Chain [1] done processing
03:04:49 - cmdstanpy - INFO - Chain [1] start processing
03:04:50 - cmdstanpy - INFO - Chain [1] done processing
03:04:51 - cmdstanpy - INFO - Chain [1] start processing
03:04:51 - cmdstanpy - INFO - Chain [1] start processing
03:04:51 - cmdstanpy - INFO - Chain [1] start processing
03:04:51 - cmdstanpy - INFO - Chain [1] start processing
03:04:51 - cmdstanpy - INFO - Chain [1] done processing
03:04:51 - cmdstanpy - INFO - Chain [1] done processing
03:04:51 - cmdstanpy - INFO - Chain [1] done processing
03:04:51 - cmdstanpy - INFO - Chain [1] done processing
03:04:51 - cmdstanpy - INFO - Chain [1] start processing
03:04:52 - cmdstanpy - INFO - Chain [1] done processing
03:04:53 - cmdstanpy - INFO - Chain [1] start processing
03:04:53 - cmdstanpy - INFO - Chain [1] start processing
03:04:53 - cmdstanpy - INFO - Chain [1] start processing
03:04:53 - cmdstanpy - INFO - Chain [1] start processing
03:04:53 - cmdstanpy - INFO - Chain [1] done processing
03:04:53 - cmdstanpy - INFO - Chain [1] done processing
03:04:53 - cmdstanpy - INFO - Chain [1] done processing
03:04:53 - cmdstanpy - INFO - Chain [1] done processing
03:04:53 - cmdstanpy - INFO - Chain [1] start processing
03:04:54 - cmdstanpy - INFO - Chain [1] done processing
03:04:55 - cmdstanpy - INFO - Chain [1] start processing
03:04:55 - cmdstanpy - INFO - Chain [1] start processing
03:04:55 - cmdstanpy - INFO - Chain [1] start processing
03:04:55 - cmdstanpy - INFO - Chain [1] start processing
03:04:55 - cmdstanpy - INFO - Chain [1] done processing
03:04:55 - cmdstanpy - INFO - Chain [1] done processing
03:04:55 - cmdstanpy - INFO - Chain [1] done processing
03:04:55 - cmdstanpy - INFO - Chain [1] done processing
03:04:55 - cmdstanpy - INFO - Chain [1] start processing
03:04:57 - cmdstanpy - INFO - Chain [1] done processing
03:04:57 - cmdstanpy - INFO - Chain [1] start processing
03:04:57 - cmdstanpy - INFO - Chain [1] start processing
03:04:57 - cmdstanpy - INFO - Chain [1] start processing
03:04:57 - cmdstanpy - INFO - Chain [1] start processing
03:04:57 - cmdstanpy - INFO - Chain [1] done processing
03:04:57 - cmdstanpy - INFO - Chain [1] done processing
03:04:57 - cmdstanpy - INFO - Chain [1] done processing
03:04:58 - cmdstanpy - INFO - Chain [1] done processing
03:04:58 - cmdstanpy - INFO - Chain [1] start processing
03:04:59 - cmdstanpy - INFO - Chain [1] done processing
03:04:59 - cmdstanpy - INFO - Chain [1] start processing
03:04:59 - cmdstanpy - INFO - Chain [1] start processing
03:04:59 - cmdstanpy - INFO - Chain [1] start processing
03:04:59 - cmdstanpy - INFO - Chain [1] start processing
03:05:00 - cmdstanpy - INFO - Chain [1] done processing
03:05:00 - cmdstanpy - INFO - Chain [1] done processing
03:05:00 - cmdstanpy - INFO - Chain [1] done processing
03:05:00 - cmdstanpy - INFO - Chain [1] done processing
03:05:00 - cmdstanpy - INFO - Chain [1] start processing
03:05:01 - cmdstanpy - INFO - Chain [1] done processing
03:05:01 - cmdstanpy - INFO - Chain [1] start processing
03:05:02 - cmdstanpy - INFO - Chain [1] start processing
03:05:02 - cmdstanpy - INFO - Chain [1] start processing
03:05:02 - cmdstanpy - INFO - Chain [1] start processing
03:05:02 - cmdstanpy - INFO - Chain [1] done processing
03:05:02 - cmdstanpy - INFO - Chain [1] done processing
03:05:02 - cmdstanpy - INFO - Chain [1] done processing
03:05:02 - cmdstanpy - INFO - Chain [1] done processing
03:05:02 - cmdstanpy - INFO - Chain [1] start processing
03:05:03 - cmdstanpy - INFO - Chain [1] done processing
03:05:04 - cmdstanpy - INFO - Chain [1] start processing
03:05:04 - cmdstanpy - INFO - Chain [1] start processing
03:05:04 - cmdstanpy - INFO - Chain [1] start processing
03:05:04 - cmdstanpy - INFO - Chain [1] start processing
03:05:04 - cmdstanpy - INFO - Chain [1] done processing
03:05:04 - cmdstanpy - INFO - Chain [1] done processing
03:05:04 - cmdstanpy - INFO - Chain [1] done processing
03:05:04 - cmdstanpy - INFO - Chain [1] done processing
03:05:04 - cmdstanpy - INFO - Chain [1] start processing
03:05:05 - cmdstanpy - INFO - Chain [1] done processing
03:05:06 - cmdstanpy - INFO - Chain [1] start processing
03:05:06 - cmdstanpy - INFO - Chain [1] start processing
03:05:06 - cmdstanpy - INFO - Chain [1] start processing
03:05:06 - cmdstanpy - INFO - Chain [1] start processing
03:05:06 - cmdstanpy - INFO - Chain [1] done processing
03:05:06 - cmdstanpy - INFO - Chain [1] done processing
03:05:06 - cmdstanpy - INFO - Chain [1] done processing
03:05:06 - cmdstanpy - INFO - Chain [1] done processing
03:05:06 - cmdstanpy - INFO - Chain [1] start processing
03:05:07 - cmdstanpy - INFO - Chain [1] done processing
03:05:08 - cmdstanpy - INFO - Chain [1] start processing
03:05:08 - cmdstanpy - INFO - Chain [1] start processing
03:05:08 - cmdstanpy - INFO - Chain [1] start processing
03:05:08 - cmdstanpy - INFO - Chain [1] start processing
03:05:08 - cmdstanpy - INFO - Chain [1] done processing
03:05:08 - cmdstanpy - INFO - Chain [1] done processing
03:05:08 - cmdstanpy - INFO - Chain [1] done processing
03:05:08 - cmdstanpy - INFO - Chain [1] done processing
03:05:08 - cmdstanpy - INFO - Chain [1] start processing
03:05:09 - cmdstanpy - INFO - Chain [1] done processing
03:05:10 - cmdstanpy - INFO - Chain [1] start processing
03:05:10 - cmdstanpy - INFO - Chain [1] start processing
03:05:10 - cmdstanpy - INFO - Chain [1] start processing
03:05:10 - cmdstanpy - INFO - Chain [1] start processing
03:05:10 - cmdstanpy - INFO - Chain [1] done processing
03:05:10 - cmdstanpy - INFO - Chain [1] done processing
03:05:10 - cmdstanpy - INFO - Chain [1] done processing
03:05:10 - cmdstanpy - INFO - Chain [1] done processing
03:05:10 - cmdstanpy - INFO - Chain [1] start processing
03:05:11 - cmdstanpy - INFO - Chain [1] done processing
03:05:12 - cmdstanpy - INFO - Chain [1] start processing
03:05:12 - cmdstanpy - INFO - Chain [1] start processing
03:05:12 - cmdstanpy - INFO - Chain [1] start processing
03:05:12 - cmdstanpy - INFO - Chain [1] start processing
03:05:12 - cmdstanpy - INFO - Chain [1] done processing
03:05:12 - cmdstanpy - INFO - Chain [1] done processing
03:05:12 - cmdstanpy - INFO - Chain [1] done processing
03:05:12 - cmdstanpy - INFO - Chain [1] done processing
03:05:12 - cmdstanpy - INFO - Chain [1] start processing
03:05:13 - cmdstanpy - INFO - Chain [1] done processing
03:05:14 - cmdstanpy - INFO - Chain [1] start processing
03:05:14 - cmdstanpy - INFO - Chain [1] start processing
03:05:14 - cmdstanpy - INFO - Chain [1] start processing
03:05:14 - cmdstanpy - INFO - Chain [1] start processing
03:05:14 - cmdstanpy - INFO - Chain [1] done processing
03:05:14 - cmdstanpy - INFO - Chain [1] done processing
03:05:14 - cmdstanpy - INFO - Chain [1] done processing
03:05:14 - cmdstanpy - INFO - Chain [1] done processing
03:05:14 - cmdstanpy - INFO - Chain [1] start processing
03:05:14 - cmdstanpy - INFO - Chain [1] done processing
03:05:15 - cmdstanpy - INFO - Chain [1] start processing
03:05:15 - cmdstanpy - INFO - Chain [1] start processing
03:05:15 - cmdstanpy - INFO - Chain [1] start processing
03:05:15 - cmdstanpy - INFO - Chain [1] start processing
03:05:15 - cmdstanpy - INFO - Chain [1] done processing
03:05:15 - cmdstanpy - INFO - Chain [1] done processing
03:05:15 - cmdstanpy - INFO - Chain [1] done processing
03:05:15 - cmdstanpy - INFO - Chain [1] done processing
03:05:15 - cmdstanpy - INFO - Chain [1] start processing
03:05:15 - cmdstanpy - INFO - Chain [1] done processing
03:05:16 - cmdstanpy - INFO - Chain [1] start processing
03:05:16 - cmdstanpy - INFO - Chain [1] start processing
03:05:16 - cmdstanpy - INFO - Chain [1] done processing
03:05:16 - cmdstanpy - INFO - Chain [1] start processing
03:05:16 - cmdstanpy - INFO - Chain [1] start processing
03:05:16 - cmdstanpy - INFO - Chain [1] done processing
03:05:16 - cmdstanpy - INFO - Chain [1] done processing
03:05:16 - cmdstanpy - INFO - Chain [1] done processing
03:05:16 - cmdstanpy - INFO - Chain [1] start processing
03:05:17 - cmdstanpy - INFO - Chain [1] done processing
03:05:17 - cmdstanpy - INFO - Chain [1] start processing
03:05:17 - cmdstanpy - INFO - Chain [1] start processing
03:05:17 - cmdstanpy - INFO - Chain [1] start processing
03:05:17 - cmdstanpy - INFO - Chain [1] start processing
03:05:17 - cmdstanpy - INFO - Chain [1] done processing
03:05:17 - cmdstanpy - INFO - Chain [1] done processing
03:05:17 - cmdstanpy - INFO - Chain [1] done processing
03:05:18 - cmdstanpy - INFO - Chain [1] done processing
03:05:18 - cmdstanpy - INFO - Chain [1] start processing
03:05:18 - cmdstanpy - INFO - Chain [1] done processing
03:05:18 - cmdstanpy - INFO - Chain [1] start processing
03:05:18 - cmdstanpy - INFO - Chain [1] start processing
03:05:18 - cmdstanpy - INFO - Chain [1] start processing
03:05:18 - cmdstanpy - INFO - Chain [1] done processing
03:05:18 - cmdstanpy - INFO - Chain [1] start processing
03:05:19 - cmdstanpy - INFO - Chain [1] done processing
03:05:19 - cmdstanpy - INFO - Chain [1] done processing
03:05:19 - cmdstanpy - INFO - Chain [1] done processing
03:05:19 - cmdstanpy - INFO - Chain [1] start processing
03:05:19 - cmdstanpy - INFO - Chain [1] done processing
03:05:20 - cmdstanpy - INFO - Chain [1] start processing
03:05:20 - cmdstanpy - INFO - Chain [1] start processing
03:05:20 - cmdstanpy - INFO - Chain [1] done processing
03:05:20 - cmdstanpy - INFO - Chain [1] start processing
03:05:20 - cmdstanpy - INFO - Chain [1] start processing
03:05:20 - cmdstanpy - INFO - Chain [1] done processing
03:05:20 - cmdstanpy - INFO - Chain [1] done processing
03:05:20 - cmdstanpy - INFO - Chain [1] done processing
03:05:20 - cmdstanpy - INFO - Chain [1] start processing
03:05:20 - cmdstanpy - INFO - Chain [1] done processing
03:05:21 - cmdstanpy - INFO - Chain [1] start processing
03:05:21 - cmdstanpy - INFO - Chain [1] start processing
03:05:21 - cmdstanpy - INFO - Chain [1] start processing
03:05:21 - cmdstanpy - INFO - Chain [1] start processing
03:05:21 - cmdstanpy - INFO - Chain [1] done processing
03:05:21 - cmdstanpy - INFO - Chain [1] done processing
03:05:21 - cmdstanpy - INFO - Chain [1] done processing
03:05:21 - cmdstanpy - INFO - Chain [1] done processing
03:05:21 - cmdstanpy - INFO - Chain [1] start processing
03:05:21 - cmdstanpy - INFO - Chain [1] done processing
03:05:22 - cmdstanpy - INFO - Chain [1] start processing
03:05:22 - cmdstanpy - INFO - Chain [1] start processing
03:05:22 - cmdstanpy - INFO - Chain [1] start processing
03:05:22 - cmdstanpy - INFO - Chain [1] start processing
03:05:22 - cmdstanpy - INFO - Chain [1] done processing
03:05:22 - cmdstanpy - INFO - Chain [1] done processing
03:05:22 - cmdstanpy - INFO - Chain [1] done processing
03:05:22 - cmdstanpy - INFO - Chain [1] done processing
03:05:22 - cmdstanpy - INFO - Chain [1] start processing
03:05:22 - cmdstanpy - INFO - Chain [1] done processing
03:05:23 - cmdstanpy - INFO - Chain [1] start processing
03:05:23 - cmdstanpy - INFO - Chain [1] start processing
03:05:23 - cmdstanpy - INFO - Chain [1] start processing
03:05:23 - cmdstanpy - INFO - Chain [1] start processing
03:05:23 - cmdstanpy - INFO - Chain [1] done processing
03:05:23 - cmdstanpy - INFO - Chain [1] done processing
03:05:23 - cmdstanpy - INFO - Chain [1] done processing
03:05:23 - cmdstanpy - INFO - Chain [1] done processing
03:05:23 - cmdstanpy - INFO - Chain [1] start processing
03:05:23 - cmdstanpy - INFO - Chain [1] done processing
03:05:24 - cmdstanpy - INFO - Chain [1] start processing
03:05:24 - cmdstanpy - INFO - Chain [1] start processing
03:05:24 - cmdstanpy - INFO - Chain [1] start processing
03:05:24 - cmdstanpy - INFO - Chain [1] done processing
03:05:24 - cmdstanpy - INFO - Chain [1] start processing
03:05:24 - cmdstanpy - INFO - Chain [1] done processing
03:05:24 - cmdstanpy - INFO - Chain [1] done processing
03:05:24 - cmdstanpy - INFO - Chain [1] done processing
03:05:24 - cmdstanpy - INFO - Chain [1] start processing
03:05:24 - cmdstanpy - INFO - Chain [1] done processing
03:05:25 - cmdstanpy - INFO - Chain [1] start processing
03:05:25 - cmdstanpy - INFO - Chain [1] start processing
03:05:25 - cmdstanpy - INFO - Chain [1] start processing
03:05:25 - cmdstanpy - INFO - Chain [1] start processing
03:05:25 - cmdstanpy - INFO - Chain [1] done processing
03:05:25 - cmdstanpy - INFO - Chain [1] done processing
03:05:25 - cmdstanpy - INFO - Chain [1] done processing
03:05:25 - cmdstanpy - INFO - Chain [1] done processing
03:05:25 - cmdstanpy - INFO - Chain [1] start processing
03:05:26 - cmdstanpy - INFO - Chain [1] done processing
03:05:26 - cmdstanpy - INFO - Chain [1] start processing
03:05:26 - cmdstanpy - INFO - Chain [1] start processing
03:05:26 - cmdstanpy - INFO - Chain [1] start processing
03:05:26 - cmdstanpy - INFO - Chain [1] done processing
03:05:26 - cmdstanpy - INFO - Chain [1] start processing
03:05:26 - cmdstanpy - INFO - Chain [1] done processing
03:05:26 - cmdstanpy - INFO - Chain [1] done processing
03:05:27 - cmdstanpy - INFO - Chain [1] done processing
03:05:27 - cmdstanpy - INFO - Chain [1] start processing
03:05:27 - cmdstanpy - INFO - Chain [1] done processing
03:05:27 - cmdstanpy - INFO - Chain [1] start processing
03:05:27 - cmdstanpy - INFO - Chain [1] start processing
03:05:27 - cmdstanpy - INFO - Chain [1] start processing
03:05:28 - cmdstanpy - INFO - Chain [1] start processing
03:05:28 - cmdstanpy - INFO - Chain [1] done processing
03:05:28 - cmdstanpy - INFO - Chain [1] done processing
03:05:28 - cmdstanpy - INFO - Chain [1] done processing
03:05:28 - cmdstanpy - INFO - Chain [1] done processing
03:05:28 - cmdstanpy - INFO - Chain [1] start processing
03:05:28 - cmdstanpy - INFO - Chain [1] done processing
03:05:29 - cmdstanpy - INFO - Chain [1] start processing
03:05:29 - cmdstanpy - INFO - Chain [1] start processing
03:05:29 - cmdstanpy - INFO - Chain [1] start processing
03:05:29 - cmdstanpy - INFO - Chain [1] done processing
03:05:29 - cmdstanpy - INFO - Chain [1] done processing
03:05:29 - cmdstanpy - INFO - Chain [1] start processing
03:05:29 - cmdstanpy - INFO - Chain [1] done processing
03:05:29 - cmdstanpy - INFO - Chain [1] done processing
03:05:29 - cmdstanpy - INFO - Chain [1] start processing
03:05:29 - cmdstanpy - INFO - Chain [1] done processing
03:05:30 - cmdstanpy - INFO - Chain [1] start processing
03:05:30 - cmdstanpy - INFO - Chain [1] start processing
03:05:30 - cmdstanpy - INFO - Chain [1] start processing
03:05:30 - cmdstanpy - INFO - Chain [1] start processing
03:05:30 - cmdstanpy - INFO - Chain [1] done processing
03:05:30 - cmdstanpy - INFO - Chain [1] done processing
03:05:30 - cmdstanpy - INFO - Chain [1] done processing
03:05:30 - cmdstanpy - INFO - Chain [1] done processing
03:05:30 - cmdstanpy - INFO - Chain [1] start processing
03:05:30 - cmdstanpy - INFO - Chain [1] done processing
03:05:31 - cmdstanpy - INFO - Chain [1] start processing
03:05:31 - cmdstanpy - INFO - Chain [1] start processing
03:05:31 - cmdstanpy - INFO - Chain [1] start processing
03:05:31 - cmdstanpy - INFO - Chain [1] start processing
03:05:31 - cmdstanpy - INFO - Chain [1] done processing
03:05:31 - cmdstanpy - INFO - Chain [1] done processing
03:05:31 - cmdstanpy - INFO - Chain [1] done processing
03:05:31 - cmdstanpy - INFO - Chain [1] done processing
03:05:31 - cmdstanpy - INFO - Chain [1] start processing
03:05:31 - cmdstanpy - INFO - Chain [1] done processing
03:05:32 - cmdstanpy - INFO - Chain [1] start processing
03:05:32 - cmdstanpy - INFO - Chain [1] start processing
03:05:32 - cmdstanpy - INFO - Chain [1] start processing
03:05:32 - cmdstanpy - INFO - Chain [1] start processing
03:05:32 - cmdstanpy - INFO - Chain [1] done processing
03:05:32 - cmdstanpy - INFO - Chain [1] done processing
03:05:32 - cmdstanpy - INFO - Chain [1] done processing
03:05:32 - cmdstanpy - INFO - Chain [1] done processing
03:05:32 - cmdstanpy - INFO - Chain [1] start processing
03:05:32 - cmdstanpy - INFO - Chain [1] done processing
03:05:33 - cmdstanpy - INFO - Chain [1] start processing
03:05:33 - cmdstanpy - INFO - Chain [1] start processing
03:05:33 - cmdstanpy - INFO - Chain [1] start processing
03:05:33 - cmdstanpy - INFO - Chain [1] start processing
03:05:33 - cmdstanpy - INFO - Chain [1] done processing
03:05:33 - cmdstanpy - INFO - Chain [1] done processing
03:05:33 - cmdstanpy - INFO - Chain [1] done processing
03:05:33 - cmdstanpy - INFO - Chain [1] done processing
03:05:33 - cmdstanpy - INFO - Chain [1] start processing
03:05:34 - cmdstanpy - INFO - Chain [1] done processing
03:05:34 - cmdstanpy - INFO - Chain [1] start processing
03:05:34 - cmdstanpy - INFO - Chain [1] start processing
03:05:34 - cmdstanpy - INFO - Chain [1] done processing
03:05:34 - cmdstanpy - INFO - Chain [1] start processing
03:05:34 - cmdstanpy - INFO - Chain [1] start processing
03:05:34 - cmdstanpy - INFO - Chain [1] done processing
03:05:34 - cmdstanpy - INFO - Chain [1] done processing
03:05:35 - cmdstanpy - INFO - Chain [1] done processing
03:05:35 - cmdstanpy - INFO - Chain [1] start processing
03:05:35 - cmdstanpy - INFO - Chain [1] done processing
03:05:35 - cmdstanpy - INFO - Chain [1] start processing
03:05:35 - cmdstanpy - INFO - Chain [1] start processing
03:05:35 - cmdstanpy - INFO - Chain [1] start processing
03:05:35 - cmdstanpy - INFO - Chain [1] start processing
03:05:35 - cmdstanpy - INFO - Chain [1] done processing
03:05:36 - cmdstanpy - INFO - Chain [1] done processing
03:05:36 - cmdstanpy - INFO - Chain [1] done processing
03:05:36 - cmdstanpy - INFO - Chain [1] done processing
03:05:36 - cmdstanpy - INFO - Chain [1] start processing
03:05:36 - cmdstanpy - INFO - Chain [1] done processing
03:05:37 - cmdstanpy - INFO - Chain [1] start processing
03:05:37 - cmdstanpy - INFO - Chain [1] start processing
03:05:37 - cmdstanpy - INFO - Chain [1] start processing
03:05:37 - cmdstanpy - INFO - Chain [1] start processing
03:05:37 - cmdstanpy - INFO - Chain [1] done processing
03:05:37 - cmdstanpy - INFO - Chain [1] done processing
03:05:37 - cmdstanpy - INFO - Chain [1] done processing
03:05:37 - cmdstanpy - INFO - Chain [1] done processing
03:05:37 - cmdstanpy - INFO - Chain [1] start processing
03:05:37 - cmdstanpy - INFO - Chain [1] done processing
03:05:38 - cmdstanpy - INFO - Chain [1] start processing
03:05:38 - cmdstanpy - INFO - Chain [1] start processing
03:05:38 - cmdstanpy - INFO - Chain [1] start processing
03:05:38 - cmdstanpy - INFO - Chain [1] start processing
03:05:38 - cmdstanpy - INFO - Chain [1] done processing
03:05:38 - cmdstanpy - INFO - Chain [1] done processing
03:05:38 - cmdstanpy - INFO - Chain [1] done processing
03:05:38 - cmdstanpy - INFO - Chain [1] done processing
03:05:38 - cmdstanpy - INFO - Chain [1] start processing
03:05:38 - cmdstanpy - INFO - Chain [1] done processing
03:05:39 - cmdstanpy - INFO - Chain [1] start processing
03:05:39 - cmdstanpy - INFO - Chain [1] start processing
03:05:39 - cmdstanpy - INFO - Chain [1] start processing
03:05:39 - cmdstanpy - INFO - Chain [1] done processing
03:05:39 - cmdstanpy - INFO - Chain [1] start processing
03:05:39 - cmdstanpy - INFO - Chain [1] done processing
03:05:39 - cmdstanpy - INFO - Chain [1] done processing
03:05:39 - cmdstanpy - INFO - Chain [1] done processing
03:05:39 - cmdstanpy - INFO - Chain [1] start processing
03:05:39 - cmdstanpy - INFO - Chain [1] done processing
03:05:40 - cmdstanpy - INFO - Chain [1] start processing
03:05:40 - cmdstanpy - INFO - Chain [1] start processing
03:05:40 - cmdstanpy - INFO - Chain [1] start processing
03:05:40 - cmdstanpy - INFO - Chain [1] start processing
03:05:40 - cmdstanpy - INFO - Chain [1] done processing
03:05:40 - cmdstanpy - INFO - Chain [1] done processing
03:05:40 - cmdstanpy - INFO - Chain [1] done processing
03:05:40 - cmdstanpy - INFO - Chain [1] done processing
03:05:40 - cmdstanpy - INFO - Chain [1] start processing
03:05:40 - cmdstanpy - INFO - Chain [1] done processing
03:05:41 - cmdstanpy - INFO - Chain [1] start processing
03:05:41 - cmdstanpy - INFO - Chain [1] start processing
03:05:41 - cmdstanpy - INFO - Chain [1] start processing
03:05:41 - cmdstanpy - INFO - Chain [1] start processing
03:05:41 - cmdstanpy - INFO - Chain [1] done processing
03:05:41 - cmdstanpy - INFO - Chain [1] done processing
03:05:41 - cmdstanpy - INFO - Chain [1] done processing
03:05:41 - cmdstanpy - INFO - Chain [1] done processing
03:05:41 - cmdstanpy - INFO - Chain [1] start processing
03:05:41 - cmdstanpy - INFO - Chain [1] done processing
03:05:42 - cmdstanpy - INFO - Chain [1] start processing
03:05:42 - cmdstanpy - INFO - Chain [1] start processing
03:05:42 - cmdstanpy - INFO - Chain [1] start processing
03:05:42 - cmdstanpy - INFO - Chain [1] start processing
03:05:42 - cmdstanpy - INFO - Chain [1] done processing
03:05:42 - cmdstanpy - INFO - Chain [1] done processing
03:05:42 - cmdstanpy - INFO - Chain [1] done processing
03:05:42 - cmdstanpy - INFO - Chain [1] done processing
03:05:42 - cmdstanpy - INFO - Chain [1] start processing
03:05:42 - cmdstanpy - INFO - Chain [1] done processing
03:05:43 - cmdstanpy - INFO - Chain [1] start processing
03:05:43 - cmdstanpy - INFO - Chain [1] start processing
03:05:43 - cmdstanpy - INFO - Chain [1] start processing
03:05:43 - cmdstanpy - INFO - Chain [1] done processing
03:05:43 - cmdstanpy - INFO - Chain [1] start processing
03:05:43 - cmdstanpy - INFO - Chain [1] done processing
03:05:43 - cmdstanpy - INFO - Chain [1] done processing
03:05:43 - cmdstanpy - INFO - Chain [1] done processing
03:05:43 - cmdstanpy - INFO - Chain [1] start processing
03:05:44 - cmdstanpy - INFO - Chain [1] done processing
03:05:44 - cmdstanpy - INFO - Chain [1] start processing
03:05:44 - cmdstanpy - INFO - Chain [1] start processing
03:05:44 - cmdstanpy - INFO - Chain [1] start processing
03:05:44 - cmdstanpy - INFO - Chain [1] start processing
03:05:44 - cmdstanpy - INFO - Chain [1] done processing
03:05:44 - cmdstanpy - INFO - Chain [1] done processing
03:05:44 - cmdstanpy - INFO - Chain [1] done processing
03:05:45 - cmdstanpy - INFO - Chain [1] done processing
03:05:45 - cmdstanpy - INFO - Chain [1] start processing
03:05:45 - cmdstanpy - INFO - Chain [1] done processing
03:05:45 - cmdstanpy - INFO - Chain [1] start processing
03:05:45 - cmdstanpy - INFO - Chain [1] start processing
03:05:46 - cmdstanpy - INFO - Chain [1] start processing
03:05:46 - cmdstanpy - INFO - Chain [1] done processing
03:05:46 - cmdstanpy - INFO - Chain [1] start processing
03:05:46 - cmdstanpy - INFO - Chain [1] done processing
03:05:46 - cmdstanpy - INFO - Chain [1] done processing
03:05:46 - cmdstanpy - INFO - Chain [1] done processing
03:05:46 - cmdstanpy - INFO - Chain [1] start processing
03:05:46 - cmdstanpy - INFO - Chain [1] done processing
03:05:47 - cmdstanpy - INFO - Chain [1] start processing
03:05:47 - cmdstanpy - INFO - Chain [1] start processing
03:05:47 - cmdstanpy - INFO - Chain [1] start processing
03:05:47 - cmdstanpy - INFO - Chain [1] done processing
03:05:47 - cmdstanpy - INFO - Chain [1] start processing
03:05:47 - cmdstanpy - INFO - Chain [1] done processing
03:05:47 - cmdstanpy - INFO - Chain [1] done processing
03:05:47 - cmdstanpy - INFO - Chain [1] done processing
03:05:47 - cmdstanpy - INFO - Chain [1] start processing
03:05:47 - cmdstanpy - INFO - Chain [1] done processing
03:05:48 - cmdstanpy - INFO - Chain [1] start processing
03:05:48 - cmdstanpy - INFO - Chain [1] start processing
03:05:48 - cmdstanpy - INFO - Chain [1] start processing
03:05:48 - cmdstanpy - INFO - Chain [1] done processing
03:05:48 - cmdstanpy - INFO - Chain [1] start processing
03:05:48 - cmdstanpy - INFO - Chain [1] done processing
03:05:48 - cmdstanpy - INFO - Chain [1] done processing
03:05:48 - cmdstanpy - INFO - Chain [1] done processing
03:05:48 - cmdstanpy - INFO - Chain [1] start processing
03:05:48 - cmdstanpy - INFO - Chain [1] done processing
03:05:49 - cmdstanpy - INFO - Chain [1] start processing
03:05:49 - cmdstanpy - INFO - Chain [1] start processing
03:05:49 - cmdstanpy - INFO - Chain [1] start processing
03:05:49 - cmdstanpy - INFO - Chain [1] done processing
03:05:49 - cmdstanpy - INFO - Chain [1] start processing
03:05:49 - cmdstanpy - INFO - Chain [1] done processing
03:05:49 - cmdstanpy - INFO - Chain [1] done processing
03:05:49 - cmdstanpy - INFO - Chain [1] done processing
03:05:49 - cmdstanpy - INFO - Chain [1] start processing
03:05:49 - cmdstanpy - INFO - Chain [1] done processing
03:05:50 - cmdstanpy - INFO - Chain [1] start processing
03:05:50 - cmdstanpy - INFO - Chain [1] start processing
03:05:50 - cmdstanpy - INFO - Chain [1] start processing
03:05:50 - cmdstanpy - INFO - Chain [1] start processing
03:05:50 - cmdstanpy - INFO - Chain [1] done processing
03:05:50 - cmdstanpy - INFO - Chain [1] done processing
03:05:50 - cmdstanpy - INFO - Chain [1] done processing
03:05:50 - cmdstanpy - INFO - Chain [1] done processing
03:05:50 - cmdstanpy - INFO - Chain [1] start processing
03:05:50 - cmdstanpy - INFO - Chain [1] done processing
03:05:51 - cmdstanpy - INFO - Chain [1] start processing
03:05:51 - cmdstanpy - INFO - Chain [1] start processing
03:05:51 - cmdstanpy - INFO - Chain [1] start processing
03:05:51 - cmdstanpy - INFO - Chain [1] start processing
03:05:51 - cmdstanpy - INFO - Chain [1] done processing
03:05:51 - cmdstanpy - INFO - Chain [1] done processing
03:05:51 - cmdstanpy - INFO - Chain [1] done processing
03:05:51 - cmdstanpy - INFO - Chain [1] done processing
03:05:51 - cmdstanpy - INFO - Chain [1] start processing
03:05:52 - cmdstanpy - INFO - Chain [1] done processing
03:05:52 - cmdstanpy - INFO - Chain [1] start processing
03:05:52 - cmdstanpy - INFO - Chain [1] start processing
03:05:52 - cmdstanpy - INFO - Chain [1] start processing
03:05:52 - cmdstanpy - INFO - Chain [1] start processing
03:05:53 - cmdstanpy - INFO - Chain [1] done processing
03:05:53 - cmdstanpy - INFO - Chain [1] done processing
03:05:53 - cmdstanpy - INFO - Chain [1] done processing
03:05:53 - cmdstanpy - INFO - Chain [1] done processing
03:05:53 - cmdstanpy - INFO - Chain [1] start processing
03:05:53 - cmdstanpy - INFO - Chain [1] done processing
03:05:54 - cmdstanpy - INFO - Chain [1] start processing
03:05:54 - cmdstanpy - INFO - Chain [1] start processing
03:05:54 - cmdstanpy - INFO - Chain [1] start processing
03:05:54 - cmdstanpy - INFO - Chain [1] start processing
03:05:54 - cmdstanpy - INFO - Chain [1] done processing
03:05:54 - cmdstanpy - INFO - Chain [1] done processing
03:05:54 - cmdstanpy - INFO - Chain [1] done processing
03:05:54 - cmdstanpy - INFO - Chain [1] done processing
03:05:54 - cmdstanpy - INFO - Chain [1] start processing
03:05:54 - cmdstanpy - INFO - Chain [1] done processing
03:05:55 - cmdstanpy - INFO - Chain [1] start processing
03:05:55 - cmdstanpy - INFO - Chain [1] start processing
03:05:55 - cmdstanpy - INFO - Chain [1] start processing
03:05:55 - cmdstanpy - INFO - Chain [1] start processing
03:05:55 - cmdstanpy - INFO - Chain [1] done processing
03:05:55 - cmdstanpy - INFO - Chain [1] done processing
03:05:55 - cmdstanpy - INFO - Chain [1] done processing
03:05:55 - cmdstanpy - INFO - Chain [1] done processing
03:05:55 - cmdstanpy - INFO - Chain [1] start processing
03:05:56 - cmdstanpy - INFO - Chain [1] done processing
03:05:56 - cmdstanpy - INFO - Chain [1] start processing
03:05:56 - cmdstanpy - INFO - Chain [1] start processing
03:05:56 - cmdstanpy - INFO - Chain [1] start processing
03:05:56 - cmdstanpy - INFO - Chain [1] start processing
03:05:56 - cmdstanpy - INFO - Chain [1] done processing
03:05:56 - cmdstanpy - INFO - Chain [1] done processing
03:05:56 - cmdstanpy - INFO - Chain [1] done processing
03:05:57 - cmdstanpy - INFO - Chain [1] done processing
03:05:57 - cmdstanpy - INFO - Chain [1] start processing
03:05:57 - cmdstanpy - INFO - Chain [1] done processing
03:05:58 - cmdstanpy - INFO - Chain [1] start processing
03:05:58 - cmdstanpy - INFO - Chain [1] start processing
03:05:58 - cmdstanpy - INFO - Chain [1] start processing
03:05:58 - cmdstanpy - INFO - Chain [1] start processing
03:05:58 - cmdstanpy - INFO - Chain [1] done processing
03:05:58 - cmdstanpy - INFO - Chain [1] done processing
03:05:58 - cmdstanpy - INFO - Chain [1] done processing
03:05:58 - cmdstanpy - INFO - Chain [1] done processing
03:05:58 - cmdstanpy - INFO - Chain [1] start processing
03:05:58 - cmdstanpy - INFO - Chain [1] done processing
03:05:59 - cmdstanpy - INFO - Chain [1] start processing
03:05:59 - cmdstanpy - INFO - Chain [1] start processing
03:05:59 - cmdstanpy - INFO - Chain [1] start processing
03:05:59 - cmdstanpy - INFO - Chain [1] start processing
03:05:59 - cmdstanpy - INFO - Chain [1] done processing
03:05:59 - cmdstanpy - INFO - Chain [1] done processing
03:05:59 - cmdstanpy - INFO - Chain [1] done processing
03:05:59 - cmdstanpy - INFO - Chain [1] done processing
03:05:59 - cmdstanpy - INFO - Chain [1] start processing
03:05:59 - cmdstanpy - INFO - Chain [1] done processing
03:06:00 - cmdstanpy - INFO - Chain [1] start processing
03:06:00 - cmdstanpy - INFO - Chain [1] start processing
03:06:00 - cmdstanpy - INFO - Chain [1] start processing
03:06:00 - cmdstanpy - INFO - Chain [1] start processing
03:06:00 - cmdstanpy - INFO - Chain [1] done processing
03:06:00 - cmdstanpy - INFO - Chain [1] done processing
03:06:00 - cmdstanpy - INFO - Chain [1] done processing
03:06:00 - cmdstanpy - INFO - Chain [1] done processing
03:06:00 - cmdstanpy - INFO - Chain [1] start processing
03:06:01 - cmdstanpy - INFO - Chain [1] done processing
03:06:01 - cmdstanpy - INFO - Chain [1] start processing
03:06:01 - cmdstanpy - INFO - Chain [1] start processing
03:06:01 - cmdstanpy - INFO - Chain [1] done processing
03:06:01 - cmdstanpy - INFO - Chain [1] start processing
03:06:01 - cmdstanpy - INFO - Chain [1] start processing
03:06:01 - cmdstanpy - INFO - Chain [1] done processing
03:06:02 - cmdstanpy - INFO - Chain [1] done processing
03:06:02 - cmdstanpy - INFO - Chain [1] done processing
03:06:02 - cmdstanpy - INFO - Chain [1] start processing
03:06:02 - cmdstanpy - INFO - Chain [1] done processing
03:06:03 - cmdstanpy - INFO - Chain [1] start processing
03:06:03 - cmdstanpy - INFO - Chain [1] start processing
03:06:03 - cmdstanpy - INFO - Chain [1] start processing
03:06:03 - cmdstanpy - INFO - Chain [1] start processing
03:06:03 - cmdstanpy - INFO - Chain [1] done processing
03:06:03 - cmdstanpy - INFO - Chain [1] done processing
03:06:03 - cmdstanpy - INFO - Chain [1] done processing
03:06:03 - cmdstanpy - INFO - Chain [1] done processing
03:06:03 - cmdstanpy - INFO - Chain [1] start processing
03:06:03 - cmdstanpy - INFO - Chain [1] done processing
03:06:04 - cmdstanpy - INFO - Chain [1] start processing
03:06:04 - cmdstanpy - INFO - Chain [1] start processing
03:06:04 - cmdstanpy - INFO - Chain [1] start processing
03:06:04 - cmdstanpy - INFO - Chain [1] start processing
03:06:04 - cmdstanpy - INFO - Chain [1] done processing
03:06:04 - cmdstanpy - INFO - Chain [1] done processing
03:06:04 - cmdstanpy - INFO - Chain [1] done processing
03:06:04 - cmdstanpy - INFO - Chain [1] done processing
03:06:04 - cmdstanpy - INFO - Chain [1] start processing
03:06:05 - cmdstanpy - INFO - Chain [1] done processing
03:06:05 - cmdstanpy - INFO - Chain [1] start processing
03:06:05 - cmdstanpy - INFO - Chain [1] start processing
03:06:05 - cmdstanpy - INFO - Chain [1] start processing
03:06:05 - cmdstanpy - INFO - Chain [1] start processing
03:06:05 - cmdstanpy - INFO - Chain [1] done processing
03:06:05 - cmdstanpy - INFO - Chain [1] done processing
03:06:05 - cmdstanpy - INFO - Chain [1] done processing
03:06:06 - cmdstanpy - INFO - Chain [1] done processing
03:06:06 - cmdstanpy - INFO - Chain [1] start processing
03:06:06 - cmdstanpy - INFO - Chain [1] done processing
03:06:07 - cmdstanpy - INFO - Chain [1] start processing
03:06:07 - cmdstanpy - INFO - Chain [1] start processing
03:06:07 - cmdstanpy - INFO - Chain [1] start processing
03:06:07 - cmdstanpy - INFO - Chain [1] start processing
03:06:07 - cmdstanpy - INFO - Chain [1] done processing
03:06:07 - cmdstanpy - INFO - Chain [1] done processing
03:06:07 - cmdstanpy - INFO - Chain [1] done processing
03:06:07 - cmdstanpy - INFO - Chain [1] done processing
03:06:07 - cmdstanpy - INFO - Chain [1] start processing
03:06:07 - cmdstanpy - INFO - Chain [1] done processing
03:06:08 - cmdstanpy - INFO - Chain [1] start processing
03:06:08 - cmdstanpy - INFO - Chain [1] start processing
03:06:08 - cmdstanpy - INFO - Chain [1] start processing
03:06:08 - cmdstanpy - INFO - Chain [1] start processing
03:06:08 - cmdstanpy - INFO - Chain [1] done processing
03:06:08 - cmdstanpy - INFO - Chain [1] done processing
03:06:08 - cmdstanpy - INFO - Chain [1] done processing
03:06:08 - cmdstanpy - INFO - Chain [1] done processing
03:06:08 - cmdstanpy - INFO - Chain [1] start processing
03:06:08 - cmdstanpy - INFO - Chain [1] done processing
03:06:09 - cmdstanpy - INFO - Chain [1] start processing
03:06:09 - cmdstanpy - INFO - Chain [1] start processing
03:06:09 - cmdstanpy - INFO - Chain [1] start processing
03:06:09 - cmdstanpy - INFO - Chain [1] start processing
03:06:09 - cmdstanpy - INFO - Chain [1] done processing
03:06:09 - cmdstanpy - INFO - Chain [1] done processing
03:06:09 - cmdstanpy - INFO - Chain [1] done processing
03:06:09 - cmdstanpy - INFO - Chain [1] done processing
03:06:09 - cmdstanpy - INFO - Chain [1] start processing
03:06:10 - cmdstanpy - INFO - Chain [1] done processing
03:06:10 - cmdstanpy - INFO - Chain [1] start processing
03:06:10 - cmdstanpy - INFO - Chain [1] start processing
03:06:11 - cmdstanpy - INFO - Chain [1] start processing
03:06:11 - cmdstanpy - INFO - Chain [1] start processing
03:06:11 - cmdstanpy - INFO - Chain [1] done processing
03:06:11 - cmdstanpy - INFO - Chain [1] done processing
03:06:11 - cmdstanpy - INFO - Chain [1] done processing
03:06:11 - cmdstanpy - INFO - Chain [1] done processing
03:06:11 - cmdstanpy - INFO - Chain [1] start processing
03:06:11 - cmdstanpy - INFO - Chain [1] done processing
03:06:12 - cmdstanpy - INFO - Chain [1] start processing
03:06:12 - cmdstanpy - INFO - Chain [1] start processing
03:06:12 - cmdstanpy - INFO - Chain [1] start processing
03:06:12 - cmdstanpy - INFO - Chain [1] start processing
03:06:12 - cmdstanpy - INFO - Chain [1] done processing
03:06:12 - cmdstanpy - INFO - Chain [1] done processing
03:06:12 - cmdstanpy - INFO - Chain [1] done processing
03:06:12 - cmdstanpy - INFO - Chain [1] done processing
03:06:12 - cmdstanpy - INFO - Chain [1] start processing
03:06:12 - cmdstanpy - INFO - Chain [1] done processing
03:06:13 - cmdstanpy - INFO - Chain [1] start processing
03:06:13 - cmdstanpy - INFO - Chain [1] start processing
03:06:13 - cmdstanpy - INFO - Chain [1] start processing
03:06:13 - cmdstanpy - INFO - Chain [1] start processing
03:06:13 - cmdstanpy - INFO - Chain [1] done processing
03:06:13 - cmdstanpy - INFO - Chain [1] done processing
03:06:13 - cmdstanpy - INFO - Chain [1] done processing
03:06:13 - cmdstanpy - INFO - Chain [1] done processing
03:06:13 - cmdstanpy - INFO - Chain [1] start processing
03:06:14 - cmdstanpy - INFO - Chain [1] done processing
03:06:14 - cmdstanpy - INFO - Chain [1] start processing
03:06:14 - cmdstanpy - INFO - Chain [1] start processing
03:06:14 - cmdstanpy - INFO - Chain [1] start processing
03:06:14 - cmdstanpy - INFO - Chain [1] start processing
03:06:14 - cmdstanpy - INFO - Chain [1] done processing
03:06:14 - cmdstanpy - INFO - Chain [1] done processing
03:06:15 - cmdstanpy - INFO - Chain [1] done processing
03:06:15 - cmdstanpy - INFO - Chain [1] done processing
03:06:15 - cmdstanpy - INFO - Chain [1] start processing
03:06:15 - cmdstanpy - INFO - Chain [1] done processing
03:06:16 - cmdstanpy - INFO - Chain [1] start processing
03:06:16 - cmdstanpy - INFO - Chain [1] start processing
03:06:16 - cmdstanpy - INFO - Chain [1] start processing
03:06:16 - cmdstanpy - INFO - Chain [1] start processing
03:06:16 - cmdstanpy - INFO - Chain [1] done processing
03:06:16 - cmdstanpy - INFO - Chain [1] done processing
03:06:16 - cmdstanpy - INFO - Chain [1] done processing
03:06:16 - cmdstanpy - INFO - Chain [1] done processing
03:06:16 - cmdstanpy - INFO - Chain [1] start processing
03:06:16 - cmdstanpy - INFO - Chain [1] done processing
03:06:17 - cmdstanpy - INFO - Chain [1] start processing
03:06:17 - cmdstanpy - INFO - Chain [1] start processing
03:06:17 - cmdstanpy - INFO - Chain [1] start processing
03:06:17 - cmdstanpy - INFO - Chain [1] start processing
03:06:17 - cmdstanpy - INFO - Chain [1] done processing
03:06:17 - cmdstanpy - INFO - Chain [1] done processing
03:06:17 - cmdstanpy - INFO - Chain [1] done processing
03:06:17 - cmdstanpy - INFO - Chain [1] done processing
03:06:17 - cmdstanpy - INFO - Chain [1] start processing
03:06:17 - cmdstanpy - INFO - Chain [1] done processing
03:06:18 - cmdstanpy - INFO - Chain [1] start processing
03:06:18 - cmdstanpy - INFO - Chain [1] start processing
03:06:18 - cmdstanpy - INFO - Chain [1] start processing
03:06:18 - cmdstanpy - INFO - Chain [1] start processing
03:06:18 - cmdstanpy - INFO - Chain [1] done processing
03:06:18 - cmdstanpy - INFO - Chain [1] done processing
03:06:18 - cmdstanpy - INFO - Chain [1] done processing
03:06:19 - cmdstanpy - INFO - Chain [1] done processing
03:06:19 - cmdstanpy - INFO - Chain [1] start processing
03:06:19 - cmdstanpy - INFO - Chain [1] done processing
03:06:20 - cmdstanpy - INFO - Chain [1] start processing
03:06:20 - cmdstanpy - INFO - Chain [1] start processing
03:06:20 - cmdstanpy - INFO - Chain [1] start processing
03:06:20 - cmdstanpy - INFO - Chain [1] start processing
03:06:20 - cmdstanpy - INFO - Chain [1] done processing
03:06:20 - cmdstanpy - INFO - Chain [1] done processing
03:06:20 - cmdstanpy - INFO - Chain [1] done processing
03:06:20 - cmdstanpy - INFO - Chain [1] done processing
03:06:20 - cmdstanpy - INFO - Chain [1] start processing
03:06:20 - cmdstanpy - INFO - Chain [1] done processing
03:06:21 - cmdstanpy - INFO - Chain [1] start processing
03:06:21 - cmdstanpy - INFO - Chain [1] start processing
03:06:21 - cmdstanpy - INFO - Chain [1] start processing
03:06:21 - cmdstanpy - INFO - Chain [1] start processing
03:06:21 - cmdstanpy - INFO - Chain [1] done processing
03:06:21 - cmdstanpy - INFO - Chain [1] done processing
03:06:21 - cmdstanpy - INFO - Chain [1] done processing
03:06:21 - cmdstanpy - INFO - Chain [1] done processing
03:06:21 - cmdstanpy - INFO - Chain [1] start processing
03:06:21 - cmdstanpy - INFO - Chain [1] done processing
03:06:22 - cmdstanpy - INFO - Chain [1] start processing
03:06:22 - cmdstanpy - INFO - Chain [1] start processing
03:06:22 - cmdstanpy - INFO - Chain [1] start processing
03:06:22 - cmdstanpy - INFO - Chain [1] start processing
03:06:22 - cmdstanpy - INFO - Chain [1] done processing
03:06:22 - cmdstanpy - INFO - Chain [1] done processing
03:06:22 - cmdstanpy - INFO - Chain [1] done processing
03:06:22 - cmdstanpy - INFO - Chain [1] done processing
03:06:22 - cmdstanpy - INFO - Chain [1] start processing
03:06:23 - cmdstanpy - INFO - Chain [1] done processing
03:06:23 - cmdstanpy - INFO - Chain [1] start processing
03:06:23 - cmdstanpy - INFO - Chain [1] start processing
03:06:23 - cmdstanpy - INFO - Chain [1] start processing
03:06:23 - cmdstanpy - INFO - Chain [1] start processing
03:06:23 - cmdstanpy - INFO - Chain [1] done processing
03:06:23 - cmdstanpy - INFO - Chain [1] done processing
03:06:23 - cmdstanpy - INFO - Chain [1] done processing
03:06:24 - cmdstanpy - INFO - Chain [1] done processing
03:06:24 - cmdstanpy - INFO - Chain [1] start processing
03:06:24 - cmdstanpy - INFO - Chain [1] done processing
03:06:25 - cmdstanpy - INFO - Chain [1] start processing
03:06:25 - cmdstanpy - INFO - Chain [1] start processing
03:06:25 - cmdstanpy - INFO - Chain [1] start processing
03:06:25 - cmdstanpy - INFO - Chain [1] start processing
03:06:25 - cmdstanpy - INFO - Chain [1] done processing
03:06:25 - cmdstanpy - INFO - Chain [1] done processing
03:06:25 - cmdstanpy - INFO - Chain [1] done processing
03:06:25 - cmdstanpy - INFO - Chain [1] done processing
03:06:25 - cmdstanpy - INFO - Chain [1] start processing
03:06:25 - cmdstanpy - INFO - Chain [1] done processing
03:06:26 - cmdstanpy - INFO - Chain [1] start processing
03:06:26 - cmdstanpy - INFO - Chain [1] start processing
03:06:26 - cmdstanpy - INFO - Chain [1] start processing
03:06:26 - cmdstanpy - INFO - Chain [1] start processing
03:06:26 - cmdstanpy - INFO - Chain [1] done processing
03:06:26 - cmdstanpy - INFO - Chain [1] done processing
03:06:26 - cmdstanpy - INFO - Chain [1] done processing
03:06:26 - cmdstanpy - INFO - Chain [1] done processing
03:06:26 - cmdstanpy - INFO - Chain [1] start processing
03:06:26 - cmdstanpy - INFO - Chain [1] done processing
03:06:27 - cmdstanpy - INFO - Chain [1] start processing
03:06:27 - cmdstanpy - INFO - Chain [1] start processing
03:06:27 - cmdstanpy - INFO - Chain [1] start processing
03:06:27 - cmdstanpy - INFO - Chain [1] start processing
03:06:27 - cmdstanpy - INFO - Chain [1] done processing
03:06:27 - cmdstanpy - INFO - Chain [1] done processing
03:06:27 - cmdstanpy - INFO - Chain [1] done processing
03:06:27 - cmdstanpy - INFO - Chain [1] done processing
03:06:28 - cmdstanpy - INFO - Chain [1] start processing
03:06:28 - cmdstanpy - INFO - Chain [1] done processing
03:06:28 - cmdstanpy - INFO - Chain [1] start processing
03:06:29 - cmdstanpy - INFO - Chain [1] start processing
03:06:29 - cmdstanpy - INFO - Chain [1] start processing
03:06:29 - cmdstanpy - INFO - Chain [1] start processing
03:06:29 - cmdstanpy - INFO - Chain [1] done processing
03:06:29 - cmdstanpy - INFO - Chain [1] done processing
03:06:29 - cmdstanpy - INFO - Chain [1] done processing
03:06:29 - cmdstanpy - INFO - Chain [1] done processing
03:06:29 - cmdstanpy - INFO - Chain [1] start processing
03:06:29 - cmdstanpy - INFO - Chain [1] done processing
03:06:30 - cmdstanpy - INFO - Chain [1] start processing
03:06:30 - cmdstanpy - INFO - Chain [1] start processing
03:06:30 - cmdstanpy - INFO - Chain [1] start processing
03:06:30 - cmdstanpy - INFO - Chain [1] start processing
03:06:30 - cmdstanpy - INFO - Chain [1] done processing
03:06:30 - cmdstanpy - INFO - Chain [1] done processing
03:06:30 - cmdstanpy - INFO - Chain [1] done processing
03:06:30 - cmdstanpy - INFO - Chain [1] done processing
03:06:30 - cmdstanpy - INFO - Chain [1] start processing
03:06:30 - cmdstanpy - INFO - Chain [1] done processing
03:06:31 - cmdstanpy - INFO - Chain [1] start processing
03:06:31 - cmdstanpy - INFO - Chain [1] start processing
03:06:31 - cmdstanpy - INFO - Chain [1] start processing
03:06:31 - cmdstanpy - INFO - Chain [1] start processing
03:06:31 - cmdstanpy - INFO - Chain [1] done processing
03:06:31 - cmdstanpy - INFO - Chain [1] done processing
03:06:31 - cmdstanpy - INFO - Chain [1] done processing
03:06:31 - cmdstanpy - INFO - Chain [1] done processing
03:06:31 - cmdstanpy - INFO - Chain [1] start processing
03:06:32 - cmdstanpy - INFO - Chain [1] done processing
03:06:33 - cmdstanpy - INFO - Chain [1] start processing
03:06:33 - cmdstanpy - INFO - Chain [1] start processing
03:06:33 - cmdstanpy - INFO - Chain [1] start processing
03:06:33 - cmdstanpy - INFO - Chain [1] start processing
03:06:33 - cmdstanpy - INFO - Chain [1] done processing
03:06:33 - cmdstanpy - INFO - Chain [1] done processing
03:06:33 - cmdstanpy - INFO - Chain [1] done processing
03:06:33 - cmdstanpy - INFO - Chain [1] done processing
03:06:33 - cmdstanpy - INFO - Chain [1] start processing
03:06:34 - cmdstanpy - INFO - Chain [1] done processing
03:06:35 - cmdstanpy - INFO - Chain [1] start processing
03:06:35 - cmdstanpy - INFO - Chain [1] start processing
03:06:35 - cmdstanpy - INFO - Chain [1] start processing
03:06:35 - cmdstanpy - INFO - Chain [1] start processing
03:06:35 - cmdstanpy - INFO - Chain [1] done processing
03:06:35 - cmdstanpy - INFO - Chain [1] done processing
03:06:36 - cmdstanpy - INFO - Chain [1] done processing
03:06:36 - cmdstanpy - INFO - Chain [1] done processing
03:06:36 - cmdstanpy - INFO - Chain [1] start processing
03:06:36 - cmdstanpy - INFO - Chain [1] done processing
03:06:37 - cmdstanpy - INFO - Chain [1] start processing
03:06:37 - cmdstanpy - INFO - Chain [1] start processing
03:06:37 - cmdstanpy - INFO - Chain [1] start processing
03:06:37 - cmdstanpy - INFO - Chain [1] start processing
03:06:37 - cmdstanpy - INFO - Chain [1] done processing
03:06:38 - cmdstanpy - INFO - Chain [1] done processing
03:06:38 - cmdstanpy - INFO - Chain [1] done processing
03:06:38 - cmdstanpy - INFO - Chain [1] done processing
03:06:38 - cmdstanpy - INFO - Chain [1] start processing
03:06:39 - cmdstanpy - INFO - Chain [1] done processing
03:06:39 - cmdstanpy - INFO - Chain [1] start processing
03:06:39 - cmdstanpy - INFO - Chain [1] start processing
03:06:39 - cmdstanpy - INFO - Chain [1] start processing
03:06:39 - cmdstanpy - INFO - Chain [1] start processing
03:06:40 - cmdstanpy - INFO - Chain [1] done processing
03:06:40 - cmdstanpy - INFO - Chain [1] done processing
03:06:40 - cmdstanpy - INFO - Chain [1] done processing
03:06:40 - cmdstanpy - INFO - Chain [1] done processing
03:06:40 - cmdstanpy - INFO - Chain [1] start processing
03:06:41 - cmdstanpy - INFO - Chain [1] done processing
03:06:42 - cmdstanpy - INFO - Chain [1] start processing
03:06:42 - cmdstanpy - INFO - Chain [1] start processing
03:06:42 - cmdstanpy - INFO - Chain [1] start processing
03:06:42 - cmdstanpy - INFO - Chain [1] start processing
03:06:42 - cmdstanpy - INFO - Chain [1] done processing
03:06:42 - cmdstanpy - INFO - Chain [1] done processing
03:06:42 - cmdstanpy - INFO - Chain [1] done processing
03:06:42 - cmdstanpy - INFO - Chain [1] done processing
03:06:42 - cmdstanpy - INFO - Chain [1] start processing
03:06:43 - cmdstanpy - INFO - Chain [1] done processing
03:06:44 - cmdstanpy - INFO - Chain [1] start processing
03:06:44 - cmdstanpy - INFO - Chain [1] start processing
03:06:44 - cmdstanpy - INFO - Chain [1] start processing
03:06:44 - cmdstanpy - INFO - Chain [1] start processing
03:06:44 - cmdstanpy - INFO - Chain [1] done processing
03:06:44 - cmdstanpy - INFO - Chain [1] done processing
03:06:44 - cmdstanpy - INFO - Chain [1] done processing
03:06:44 - cmdstanpy - INFO - Chain [1] done processing
03:06:44 - cmdstanpy - INFO - Chain [1] start processing
03:06:45 - cmdstanpy - INFO - Chain [1] done processing
03:06:46 - cmdstanpy - INFO - Chain [1] start processing
03:06:46 - cmdstanpy - INFO - Chain [1] start processing
03:06:46 - cmdstanpy - INFO - Chain [1] start processing
03:06:46 - cmdstanpy - INFO - Chain [1] start processing
03:06:46 - cmdstanpy - INFO - Chain [1] done processing
03:06:46 - cmdstanpy - INFO - Chain [1] done processing
03:06:46 - cmdstanpy - INFO - Chain [1] done processing
03:06:47 - cmdstanpy - INFO - Chain [1] done processing
03:06:47 - cmdstanpy - INFO - Chain [1] start processing
03:06:47 - cmdstanpy - INFO - Chain [1] done processing
03:06:48 - cmdstanpy - INFO - Chain [1] start processing
03:06:48 - cmdstanpy - INFO - Chain [1] start processing
03:06:48 - cmdstanpy - INFO - Chain [1] start processing
03:06:48 - cmdstanpy - INFO - Chain [1] start processing
03:06:48 - cmdstanpy - INFO - Chain [1] done processing
03:06:49 - cmdstanpy - INFO - Chain [1] done processing
03:06:49 - cmdstanpy - INFO - Chain [1] done processing
03:06:49 - cmdstanpy - INFO - Chain [1] done processing
03:06:49 - cmdstanpy - INFO - Chain [1] start processing
03:06:49 - cmdstanpy - INFO - Chain [1] done processing
03:06:50 - cmdstanpy - INFO - Chain [1] start processing
03:06:50 - cmdstanpy - INFO - Chain [1] start processing
03:06:50 - cmdstanpy - INFO - Chain [1] start processing
03:06:50 - cmdstanpy - INFO - Chain [1] start processing
03:06:50 - cmdstanpy - INFO - Chain [1] done processing
03:06:51 - cmdstanpy - INFO - Chain [1] done processing
03:06:51 - cmdstanpy - INFO - Chain [1] done processing
03:06:51 - cmdstanpy - INFO - Chain [1] done processing
03:06:51 - cmdstanpy - INFO - Chain [1] start processing
03:06:52 - cmdstanpy - INFO - Chain [1] done processing
03:06:52 - cmdstanpy - INFO - Chain [1] start processing
03:06:52 - cmdstanpy - INFO - Chain [1] start processing
03:06:52 - cmdstanpy - INFO - Chain [1] start processing
03:06:52 - cmdstanpy - INFO - Chain [1] start processing
03:06:53 - cmdstanpy - INFO - Chain [1] done processing
03:06:53 - cmdstanpy - INFO - Chain [1] done processing
03:06:53 - cmdstanpy - INFO - Chain [1] done processing
03:06:53 - cmdstanpy - INFO - Chain [1] done processing
03:06:53 - cmdstanpy - INFO - Chain [1] start processing
03:06:54 - cmdstanpy - INFO - Chain [1] done processing
03:06:55 - cmdstanpy - INFO - Chain [1] start processing
03:06:55 - cmdstanpy - INFO - Chain [1] start processing
03:06:55 - cmdstanpy - INFO - Chain [1] start processing
03:06:55 - cmdstanpy - INFO - Chain [1] start processing
03:06:55 - cmdstanpy - INFO - Chain [1] done processing
03:06:55 - cmdstanpy - INFO - Chain [1] done processing
03:06:55 - cmdstanpy - INFO - Chain [1] done processing
03:06:55 - cmdstanpy - INFO - Chain [1] done processing
03:06:55 - cmdstanpy - INFO - Chain [1] start processing
03:06:56 - cmdstanpy - INFO - Chain [1] done processing
03:06:57 - cmdstanpy - INFO - Chain [1] start processing
03:06:57 - cmdstanpy - INFO - Chain [1] start processing
03:06:57 - cmdstanpy - INFO - Chain [1] start processing
03:06:57 - cmdstanpy - INFO - Chain [1] start processing
03:06:57 - cmdstanpy - INFO - Chain [1] done processing
03:06:57 - cmdstanpy - INFO - Chain [1] done processing
03:06:57 - cmdstanpy - INFO - Chain [1] done processing
03:06:57 - cmdstanpy - INFO - Chain [1] done processing
03:06:58 - cmdstanpy - INFO - Chain [1] start processing
03:06:58 - cmdstanpy - INFO - Chain [1] done processing
03:06:59 - cmdstanpy - INFO - Chain [1] start processing
03:06:59 - cmdstanpy - INFO - Chain [1] start processing
03:06:59 - cmdstanpy - INFO - Chain [1] start processing
03:06:59 - cmdstanpy - INFO - Chain [1] start processing
03:06:59 - cmdstanpy - INFO - Chain [1] done processing
03:06:59 - cmdstanpy - INFO - Chain [1] done processing
03:06:59 - cmdstanpy - INFO - Chain [1] done processing
03:07:00 - cmdstanpy - INFO - Chain [1] done processing
03:07:00 - cmdstanpy - INFO - Chain [1] start processing
03:07:00 - cmdstanpy - INFO - Chain [1] done processing
03:07:01 - cmdstanpy - INFO - Chain [1] start processing
03:07:01 - cmdstanpy - INFO - Chain [1] start processing
03:07:01 - cmdstanpy - INFO - Chain [1] start processing
03:07:01 - cmdstanpy - INFO - Chain [1] start processing
03:07:01 - cmdstanpy - INFO - Chain [1] done processing
03:07:02 - cmdstanpy - INFO - Chain [1] done processing
03:07:02 - cmdstanpy - INFO - Chain [1] done processing
03:07:02 - cmdstanpy - INFO - Chain [1] done processing
03:07:02 - cmdstanpy - INFO - Chain [1] start processing
03:07:03 - cmdstanpy - INFO - Chain [1] done processing
03:07:03 - cmdstanpy - INFO - Chain [1] start processing
03:07:03 - cmdstanpy - INFO - Chain [1] start processing
03:07:03 - cmdstanpy - INFO - Chain [1] start processing
03:07:03 - cmdstanpy - INFO - Chain [1] start processing
03:07:04 - cmdstanpy - INFO - Chain [1] done processing
03:07:04 - cmdstanpy - INFO - Chain [1] done processing
03:07:04 - cmdstanpy - INFO - Chain [1] done processing
03:07:04 - cmdstanpy - INFO - Chain [1] done processing
03:07:04 - cmdstanpy - INFO - Chain [1] start processing
03:07:05 - cmdstanpy - INFO - Chain [1] done processing
03:07:05 - cmdstanpy - INFO - Chain [1] start processing
03:07:05 - cmdstanpy - INFO - Chain [1] start processing
03:07:06 - cmdstanpy - INFO - Chain [1] start processing
03:07:06 - cmdstanpy - INFO - Chain [1] start processing
03:07:06 - cmdstanpy - INFO - Chain [1] done processing
03:07:06 - cmdstanpy - INFO - Chain [1] done processing
03:07:06 - cmdstanpy - INFO - Chain [1] done processing
03:07:06 - cmdstanpy - INFO - Chain [1] done processing
03:07:06 - cmdstanpy - INFO - Chain [1] start processing
03:07:07 - cmdstanpy - INFO - Chain [1] done processing
03:07:08 - cmdstanpy - INFO - Chain [1] start processing
03:07:08 - cmdstanpy - INFO - Chain [1] start processing
03:07:08 - cmdstanpy - INFO - Chain [1] start processing
03:07:08 - cmdstanpy - INFO - Chain [1] start processing
03:07:08 - cmdstanpy - INFO - Chain [1] done processing
03:07:08 - cmdstanpy - INFO - Chain [1] done processing
03:07:08 - cmdstanpy - INFO - Chain [1] done processing
03:07:08 - cmdstanpy - INFO - Chain [1] done processing
03:07:08 - cmdstanpy - INFO - Chain [1] start processing
03:07:09 - cmdstanpy - INFO - Chain [1] done processing
03:07:10 - cmdstanpy - INFO - Chain [1] start processing
03:07:10 - cmdstanpy - INFO - Chain [1] start processing
03:07:10 - cmdstanpy - INFO - Chain [1] start processing
03:07:10 - cmdstanpy - INFO - Chain [1] start processing
03:07:10 - cmdstanpy - INFO - Chain [1] done processing
03:07:10 - cmdstanpy - INFO - Chain [1] done processing
03:07:10 - cmdstanpy - INFO - Chain [1] done processing
03:07:11 - cmdstanpy - INFO - Chain [1] done processing
03:07:11 - cmdstanpy - INFO - Chain [1] start processing
03:07:11 - cmdstanpy - INFO - Chain [1] done processing
03:07:12 - cmdstanpy - INFO - Chain [1] start processing
03:07:12 - cmdstanpy - INFO - Chain [1] start processing
03:07:12 - cmdstanpy - INFO - Chain [1] start processing
03:07:12 - cmdstanpy - INFO - Chain [1] start processing
03:07:12 - cmdstanpy - INFO - Chain [1] done processing
03:07:13 - cmdstanpy - INFO - Chain [1] done processing
03:07:13 - cmdstanpy - INFO - Chain [1] done processing
03:07:13 - cmdstanpy - INFO - Chain [1] done processing
03:07:13 - cmdstanpy - INFO - Chain [1] start processing
03:07:14 - cmdstanpy - INFO - Chain [1] done processing
03:07:14 - cmdstanpy - INFO - Chain [1] start processing
03:07:14 - cmdstanpy - INFO - Chain [1] start processing
03:07:14 - cmdstanpy - INFO - Chain [1] start processing
03:07:14 - cmdstanpy - INFO - Chain [1] start processing
03:07:15 - cmdstanpy - INFO - Chain [1] done processing
03:07:15 - cmdstanpy - INFO - Chain [1] done processing
03:07:15 - cmdstanpy - INFO - Chain [1] done processing
03:07:15 - cmdstanpy - INFO - Chain [1] done processing
03:07:15 - cmdstanpy - INFO - Chain [1] start processing
03:07:16 - cmdstanpy - INFO - Chain [1] done processing
03:07:16 - cmdstanpy - INFO - Chain [1] start processing
03:07:16 - cmdstanpy - INFO - Chain [1] start processing
03:07:17 - cmdstanpy - INFO - Chain [1] start processing
03:07:17 - cmdstanpy - INFO - Chain [1] start processing
03:07:17 - cmdstanpy - INFO - Chain [1] done processing
03:07:17 - cmdstanpy - INFO - Chain [1] done processing
03:07:17 - cmdstanpy - INFO - Chain [1] done processing
03:07:17 - cmdstanpy - INFO - Chain [1] done processing
03:07:17 - cmdstanpy - INFO - Chain [1] start processing
03:07:18 - cmdstanpy - INFO - Chain [1] done processing
03:07:19 - cmdstanpy - INFO - Chain [1] start processing
03:07:19 - cmdstanpy - INFO - Chain [1] start processing
03:07:19 - cmdstanpy - INFO - Chain [1] start processing
03:07:19 - cmdstanpy - INFO - Chain [1] start processing
03:07:19 - cmdstanpy - INFO - Chain [1] done processing
03:07:19 - cmdstanpy - INFO - Chain [1] done processing
03:07:19 - cmdstanpy - INFO - Chain [1] done processing
03:07:19 - cmdstanpy - INFO - Chain [1] done processing
03:07:19 - cmdstanpy - INFO - Chain [1] start processing
03:07:20 - cmdstanpy - INFO - Chain [1] done processing
03:07:21 - cmdstanpy - INFO - Chain [1] start processing
03:07:21 - cmdstanpy - INFO - Chain [1] start processing
03:07:21 - cmdstanpy - INFO - Chain [1] start processing
03:07:21 - cmdstanpy - INFO - Chain [1] start processing
03:07:21 - cmdstanpy - INFO - Chain [1] done processing
03:07:21 - cmdstanpy - INFO - Chain [1] done processing
03:07:21 - cmdstanpy - INFO - Chain [1] done processing
03:07:21 - cmdstanpy - INFO - Chain [1] done processing
03:07:21 - cmdstanpy - INFO - Chain [1] start processing
03:07:22 - cmdstanpy - INFO - Chain [1] done processing
03:07:23 - cmdstanpy - INFO - Chain [1] start processing
03:07:23 - cmdstanpy - INFO - Chain [1] start processing
03:07:23 - cmdstanpy - INFO - Chain [1] start processing
03:07:23 - cmdstanpy - INFO - Chain [1] start processing
03:07:23 - cmdstanpy - INFO - Chain [1] done processing
03:07:23 - cmdstanpy - INFO - Chain [1] done processing
03:07:23 - cmdstanpy - INFO - Chain [1] done processing
03:07:24 - cmdstanpy - INFO - Chain [1] done processing
03:07:24 - cmdstanpy - INFO - Chain [1] start processing
03:07:24 - cmdstanpy - INFO - Chain [1] done processing
03:07:25 - cmdstanpy - INFO - Chain [1] start processing
03:07:25 - cmdstanpy - INFO - Chain [1] start processing
03:07:25 - cmdstanpy - INFO - Chain [1] start processing
03:07:25 - cmdstanpy - INFO - Chain [1] start processing
03:07:25 - cmdstanpy - INFO - Chain [1] done processing
03:07:25 - cmdstanpy - INFO - Chain [1] done processing
03:07:26 - cmdstanpy - INFO - Chain [1] done processing
03:07:26 - cmdstanpy - INFO - Chain [1] done processing
03:07:26 - cmdstanpy - INFO - Chain [1] start processing
03:07:27 - cmdstanpy - INFO - Chain [1] done processing
03:07:27 - cmdstanpy - INFO - Chain [1] start processing
03:07:27 - cmdstanpy - INFO - Chain [1] start processing
03:07:27 - cmdstanpy - INFO - Chain [1] start processing
03:07:27 - cmdstanpy - INFO - Chain [1] start processing
03:07:27 - cmdstanpy - INFO - Chain [1] done processing
03:07:28 - cmdstanpy - INFO - Chain [1] done processing
03:07:28 - cmdstanpy - INFO - Chain [1] done processing
03:07:28 - cmdstanpy - INFO - Chain [1] done processing
03:07:28 - cmdstanpy - INFO - Chain [1] start processing
03:07:29 - cmdstanpy - INFO - Chain [1] done processing
03:07:29 - cmdstanpy - INFO - Chain [1] start processing
03:07:29 - cmdstanpy - INFO - Chain [1] start processing
03:07:29 - cmdstanpy - INFO - Chain [1] start processing
03:07:29 - cmdstanpy - INFO - Chain [1] start processing
03:07:30 - cmdstanpy - INFO - Chain [1] done processing
03:07:30 - cmdstanpy - INFO - Chain [1] done processing
03:07:30 - cmdstanpy - INFO - Chain [1] done processing
03:07:30 - cmdstanpy - INFO - Chain [1] done processing
03:07:30 - cmdstanpy - INFO - Chain [1] start processing
03:07:31 - cmdstanpy - INFO - Chain [1] done processing
03:07:32 - cmdstanpy - INFO - Chain [1] start processing
03:07:32 - cmdstanpy - INFO - Chain [1] start processing
03:07:32 - cmdstanpy - INFO - Chain [1] start processing
03:07:32 - cmdstanpy - INFO - Chain [1] start processing
03:07:32 - cmdstanpy - INFO - Chain [1] done processing
03:07:32 - cmdstanpy - INFO - Chain [1] done processing
03:07:32 - cmdstanpy - INFO - Chain [1] done processing
03:07:32 - cmdstanpy - INFO - Chain [1] done processing
03:07:32 - cmdstanpy - INFO - Chain [1] start processing
03:07:33 - cmdstanpy - INFO - Chain [1] done processing
03:07:34 - cmdstanpy - INFO - Chain [1] start processing
03:07:34 - cmdstanpy - INFO - Chain [1] start processing
03:07:34 - cmdstanpy - INFO - Chain [1] start processing
03:07:34 - cmdstanpy - INFO - Chain [1] start processing
03:07:34 - cmdstanpy - INFO - Chain [1] done processing
03:07:34 - cmdstanpy - INFO - Chain [1] done processing
03:07:34 - cmdstanpy - INFO - Chain [1] done processing
03:07:35 - cmdstanpy - INFO - Chain [1] done processing
03:07:35 - cmdstanpy - INFO - Chain [1] start processing
03:07:35 - cmdstanpy - INFO - Chain [1] done processing
03:07:36 - cmdstanpy - INFO - Chain [1] start processing
03:07:36 - cmdstanpy - INFO - Chain [1] start processing
03:07:36 - cmdstanpy - INFO - Chain [1] start processing
03:07:36 - cmdstanpy - INFO - Chain [1] start processing
03:07:36 - cmdstanpy - INFO - Chain [1] done processing
03:07:36 - cmdstanpy - INFO - Chain [1] done processing
03:07:36 - cmdstanpy - INFO - Chain [1] done processing
03:07:37 - cmdstanpy - INFO - Chain [1] done processing
03:07:37 - cmdstanpy - INFO - Chain [1] start processing
03:07:37 - cmdstanpy - INFO - Chain [1] done processing
03:07:38 - cmdstanpy - INFO - Chain [1] start processing
03:07:38 - cmdstanpy - INFO - Chain [1] start processing
03:07:38 - cmdstanpy - INFO - Chain [1] start processing
03:07:38 - cmdstanpy - INFO - Chain [1] start processing
03:07:38 - cmdstanpy - INFO - Chain [1] done processing
03:07:39 - cmdstanpy - INFO - Chain [1] done processing
03:07:39 - cmdstanpy - INFO - Chain [1] done processing
03:07:39 - cmdstanpy - INFO - Chain [1] done processing
03:07:39 - cmdstanpy - INFO - Chain [1] start processing
03:07:40 - cmdstanpy - INFO - Chain [1] done processing
03:07:40 - cmdstanpy - INFO - Chain [1] start processing
03:07:40 - cmdstanpy - INFO - Chain [1] start processing
03:07:40 - cmdstanpy - INFO - Chain [1] start processing
03:07:40 - cmdstanpy - INFO - Chain [1] start processing
03:07:41 - cmdstanpy - INFO - Chain [1] done processing
03:07:41 - cmdstanpy - INFO - Chain [1] done processing
03:07:41 - cmdstanpy - INFO - Chain [1] done processing
03:07:41 - cmdstanpy - INFO - Chain [1] done processing
03:07:41 - cmdstanpy - INFO - Chain [1] start processing
Best parameters: {'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01, 'seasonality_mode': 'additive'}
03:07:42 - cmdstanpy - INFO - Chain [1] done processing
Test RMSE: 0.012984771707713526
03:07:43 - cmdstanpy - INFO - Chain [1] start processing
03:07:43 - cmdstanpy - INFO - Chain [1] start processing
03:07:43 - cmdstanpy - INFO - Chain [1] start processing
03:07:43 - cmdstanpy - INFO - Chain [1] start processing
03:07:43 - cmdstanpy - INFO - Chain [1] done processing
03:07:43 - cmdstanpy - INFO - Chain [1] done processing
03:07:43 - cmdstanpy - INFO - Chain [1] done processing
Cross-Validation RMSE: 0.00508977771402136
03:07:43 - cmdstanpy - INFO - Chain [1] done processing

I decided to do one more tuning just to be exhaustive.

Code
# Set the logistic growth
train['cap'] = 1  
test['cap'] = 1   

# Initialize and fit the Prophet model on the training data with logistic growth
model = Prophet(growth='logistic')
model.add_country_holidays(country_name='US')
model.fit(train)

# Updated parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.3, 0.4, 0.45, 0.5],
    'seasonality_prior_scale': [0.01, 0.015, 0.02, 0.025],
    'holidays_prior_scale': [0.01, 0.015, 0.02, 0.025]
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each set of parameters 

# Cross-validation to evaluate all parameters
for params in all_params:
    # Initialize Prophet model with logistic growth and additive seasonality
    m = Prophet(growth='logistic', seasonality_mode='additive', **params)
    m.add_country_holidays(country_name='US')
    m.fit(train)
    
    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params}")

# Fit the final model with the best parameters
final_model = Prophet(growth='logistic', **best_params)
final_model.add_country_holidays(country_name='US')
final_model.fit(train)

# Predict and evaluate on the test set
future_test = final_model.make_future_dataframe(periods=len(test), freq='W', include_history=False)
# Add the cap to the future dataframe
future_test['cap'] = 1
forecast_test = final_model.predict(future_test)
test_rmse = sqrt(mean_squared_error(test['y'], forecast_test['yhat']))
print(f"Test RMSE: {test_rmse}")

# Perform cross-validation
df_cv = cross_validation(final_model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')
03:08:58 - cmdstanpy - INFO - Chain [1] start processing
03:08:58 - cmdstanpy - INFO - Chain [1] done processing
03:08:58 - cmdstanpy - INFO - Chain [1] start processing
03:08:59 - cmdstanpy - INFO - Chain [1] done processing
03:08:59 - cmdstanpy - INFO - Chain [1] start processing
03:08:59 - cmdstanpy - INFO - Chain [1] start processing
03:08:59 - cmdstanpy - INFO - Chain [1] start processing
03:08:59 - cmdstanpy - INFO - Chain [1] start processing
03:08:59 - cmdstanpy - INFO - Chain [1] done processing
03:09:00 - cmdstanpy - INFO - Chain [1] done processing
03:09:00 - cmdstanpy - INFO - Chain [1] done processing
03:09:00 - cmdstanpy - INFO - Chain [1] done processing
03:09:00 - cmdstanpy - INFO - Chain [1] start processing
03:09:00 - cmdstanpy - INFO - Chain [1] done processing
03:09:01 - cmdstanpy - INFO - Chain [1] start processing
03:09:01 - cmdstanpy - INFO - Chain [1] start processing
03:09:01 - cmdstanpy - INFO - Chain [1] start processing
03:09:01 - cmdstanpy - INFO - Chain [1] start processing
03:09:01 - cmdstanpy - INFO - Chain [1] done processing
03:09:01 - cmdstanpy - INFO - Chain [1] done processing
03:09:01 - cmdstanpy - INFO - Chain [1] done processing
03:09:01 - cmdstanpy - INFO - Chain [1] done processing
03:09:01 - cmdstanpy - INFO - Chain [1] start processing
03:09:02 - cmdstanpy - INFO - Chain [1] done processing
03:09:02 - cmdstanpy - INFO - Chain [1] start processing
03:09:02 - cmdstanpy - INFO - Chain [1] start processing
03:09:02 - cmdstanpy - INFO - Chain [1] start processing
03:09:03 - cmdstanpy - INFO - Chain [1] start processing
03:09:03 - cmdstanpy - INFO - Chain [1] done processing
03:09:03 - cmdstanpy - INFO - Chain [1] done processing
03:09:03 - cmdstanpy - INFO - Chain [1] done processing
03:09:03 - cmdstanpy - INFO - Chain [1] done processing
03:09:03 - cmdstanpy - INFO - Chain [1] start processing
03:09:03 - cmdstanpy - INFO - Chain [1] done processing
03:09:04 - cmdstanpy - INFO - Chain [1] start processing
03:09:04 - cmdstanpy - INFO - Chain [1] start processing
03:09:04 - cmdstanpy - INFO - Chain [1] start processing
03:09:04 - cmdstanpy - INFO - Chain [1] start processing
03:09:04 - cmdstanpy - INFO - Chain [1] done processing
03:09:04 - cmdstanpy - INFO - Chain [1] done processing
03:09:04 - cmdstanpy - INFO - Chain [1] done processing
03:09:04 - cmdstanpy - INFO - Chain [1] done processing
03:09:04 - cmdstanpy - INFO - Chain [1] start processing
03:09:05 - cmdstanpy - INFO - Chain [1] done processing
03:09:06 - cmdstanpy - INFO - Chain [1] start processing
03:09:06 - cmdstanpy - INFO - Chain [1] start processing
03:09:06 - cmdstanpy - INFO - Chain [1] start processing
03:09:06 - cmdstanpy - INFO - Chain [1] start processing
03:09:06 - cmdstanpy - INFO - Chain [1] done processing
03:09:06 - cmdstanpy - INFO - Chain [1] done processing
03:09:06 - cmdstanpy - INFO - Chain [1] done processing
03:09:06 - cmdstanpy - INFO - Chain [1] done processing
03:09:06 - cmdstanpy - INFO - Chain [1] start processing
03:09:07 - cmdstanpy - INFO - Chain [1] done processing
03:09:07 - cmdstanpy - INFO - Chain [1] start processing
03:09:07 - cmdstanpy - INFO - Chain [1] start processing
03:09:07 - cmdstanpy - INFO - Chain [1] start processing
03:09:07 - cmdstanpy - INFO - Chain [1] start processing
03:09:07 - cmdstanpy - INFO - Chain [1] done processing
03:09:08 - cmdstanpy - INFO - Chain [1] done processing
03:09:08 - cmdstanpy - INFO - Chain [1] done processing
03:09:08 - cmdstanpy - INFO - Chain [1] done processing
03:09:08 - cmdstanpy - INFO - Chain [1] start processing
03:09:08 - cmdstanpy - INFO - Chain [1] done processing
03:09:09 - cmdstanpy - INFO - Chain [1] start processing
03:09:09 - cmdstanpy - INFO - Chain [1] start processing
03:09:09 - cmdstanpy - INFO - Chain [1] start processing
03:09:09 - cmdstanpy - INFO - Chain [1] start processing
03:09:09 - cmdstanpy - INFO - Chain [1] done processing
03:09:09 - cmdstanpy - INFO - Chain [1] done processing
03:09:09 - cmdstanpy - INFO - Chain [1] done processing
03:09:09 - cmdstanpy - INFO - Chain [1] done processing
03:09:09 - cmdstanpy - INFO - Chain [1] start processing
03:09:10 - cmdstanpy - INFO - Chain [1] done processing
03:09:10 - cmdstanpy - INFO - Chain [1] start processing
03:09:10 - cmdstanpy - INFO - Chain [1] start processing
03:09:10 - cmdstanpy - INFO - Chain [1] start processing
03:09:10 - cmdstanpy - INFO - Chain [1] start processing
03:09:10 - cmdstanpy - INFO - Chain [1] done processing
03:09:11 - cmdstanpy - INFO - Chain [1] done processing
03:09:11 - cmdstanpy - INFO - Chain [1] done processing
03:09:11 - cmdstanpy - INFO - Chain [1] done processing
03:09:11 - cmdstanpy - INFO - Chain [1] start processing
03:09:11 - cmdstanpy - INFO - Chain [1] done processing
03:09:12 - cmdstanpy - INFO - Chain [1] start processing
03:09:12 - cmdstanpy - INFO - Chain [1] start processing
03:09:12 - cmdstanpy - INFO - Chain [1] start processing
03:09:12 - cmdstanpy - INFO - Chain [1] start processing
03:09:12 - cmdstanpy - INFO - Chain [1] done processing
03:09:12 - cmdstanpy - INFO - Chain [1] done processing
03:09:12 - cmdstanpy - INFO - Chain [1] done processing
03:09:12 - cmdstanpy - INFO - Chain [1] done processing
03:09:12 - cmdstanpy - INFO - Chain [1] start processing
03:09:13 - cmdstanpy - INFO - Chain [1] done processing
03:09:14 - cmdstanpy - INFO - Chain [1] start processing
03:09:14 - cmdstanpy - INFO - Chain [1] start processing
03:09:14 - cmdstanpy - INFO - Chain [1] start processing
03:09:14 - cmdstanpy - INFO - Chain [1] start processing
03:09:14 - cmdstanpy - INFO - Chain [1] done processing
03:09:14 - cmdstanpy - INFO - Chain [1] done processing
03:09:14 - cmdstanpy - INFO - Chain [1] done processing
03:09:14 - cmdstanpy - INFO - Chain [1] done processing
03:09:14 - cmdstanpy - INFO - Chain [1] start processing
03:09:14 - cmdstanpy - INFO - Chain [1] done processing
03:09:15 - cmdstanpy - INFO - Chain [1] start processing
03:09:15 - cmdstanpy - INFO - Chain [1] start processing
03:09:15 - cmdstanpy - INFO - Chain [1] start processing
03:09:15 - cmdstanpy - INFO - Chain [1] start processing
03:09:15 - cmdstanpy - INFO - Chain [1] done processing
03:09:15 - cmdstanpy - INFO - Chain [1] done processing
03:09:15 - cmdstanpy - INFO - Chain [1] done processing
03:09:15 - cmdstanpy - INFO - Chain [1] done processing
03:09:15 - cmdstanpy - INFO - Chain [1] start processing
03:09:16 - cmdstanpy - INFO - Chain [1] done processing
03:09:17 - cmdstanpy - INFO - Chain [1] start processing
03:09:17 - cmdstanpy - INFO - Chain [1] start processing
03:09:17 - cmdstanpy - INFO - Chain [1] start processing
03:09:17 - cmdstanpy - INFO - Chain [1] start processing
03:09:17 - cmdstanpy - INFO - Chain [1] done processing
03:09:17 - cmdstanpy - INFO - Chain [1] done processing
03:09:17 - cmdstanpy - INFO - Chain [1] done processing
03:09:17 - cmdstanpy - INFO - Chain [1] done processing
03:09:17 - cmdstanpy - INFO - Chain [1] start processing
03:09:18 - cmdstanpy - INFO - Chain [1] done processing
03:09:18 - cmdstanpy - INFO - Chain [1] start processing
03:09:18 - cmdstanpy - INFO - Chain [1] start processing
03:09:18 - cmdstanpy - INFO - Chain [1] start processing
03:09:18 - cmdstanpy - INFO - Chain [1] start processing
03:09:18 - cmdstanpy - INFO - Chain [1] done processing
03:09:19 - cmdstanpy - INFO - Chain [1] done processing
03:09:19 - cmdstanpy - INFO - Chain [1] done processing
03:09:19 - cmdstanpy - INFO - Chain [1] done processing
03:09:19 - cmdstanpy - INFO - Chain [1] start processing
03:09:19 - cmdstanpy - INFO - Chain [1] done processing
03:09:20 - cmdstanpy - INFO - Chain [1] start processing
03:09:20 - cmdstanpy - INFO - Chain [1] start processing
03:09:20 - cmdstanpy - INFO - Chain [1] start processing
03:09:20 - cmdstanpy - INFO - Chain [1] start processing
03:09:20 - cmdstanpy - INFO - Chain [1] done processing
03:09:20 - cmdstanpy - INFO - Chain [1] done processing
03:09:20 - cmdstanpy - INFO - Chain [1] done processing
03:09:20 - cmdstanpy - INFO - Chain [1] done processing
03:09:20 - cmdstanpy - INFO - Chain [1] start processing
03:09:21 - cmdstanpy - INFO - Chain [1] done processing
03:09:21 - cmdstanpy - INFO - Chain [1] start processing
03:09:21 - cmdstanpy - INFO - Chain [1] start processing
03:09:21 - cmdstanpy - INFO - Chain [1] start processing
03:09:21 - cmdstanpy - INFO - Chain [1] start processing
03:09:21 - cmdstanpy - INFO - Chain [1] done processing
03:09:22 - cmdstanpy - INFO - Chain [1] done processing
03:09:22 - cmdstanpy - INFO - Chain [1] done processing
03:09:22 - cmdstanpy - INFO - Chain [1] done processing
03:09:22 - cmdstanpy - INFO - Chain [1] start processing
03:09:22 - cmdstanpy - INFO - Chain [1] done processing
03:09:23 - cmdstanpy - INFO - Chain [1] start processing
03:09:23 - cmdstanpy - INFO - Chain [1] start processing
03:09:23 - cmdstanpy - INFO - Chain [1] start processing
03:09:23 - cmdstanpy - INFO - Chain [1] start processing
03:09:23 - cmdstanpy - INFO - Chain [1] done processing
03:09:23 - cmdstanpy - INFO - Chain [1] done processing
03:09:23 - cmdstanpy - INFO - Chain [1] done processing
03:09:23 - cmdstanpy - INFO - Chain [1] done processing
03:09:23 - cmdstanpy - INFO - Chain [1] start processing
03:09:24 - cmdstanpy - INFO - Chain [1] done processing
03:09:25 - cmdstanpy - INFO - Chain [1] start processing
03:09:25 - cmdstanpy - INFO - Chain [1] start processing
03:09:25 - cmdstanpy - INFO - Chain [1] start processing
03:09:25 - cmdstanpy - INFO - Chain [1] start processing
03:09:25 - cmdstanpy - INFO - Chain [1] done processing
03:09:25 - cmdstanpy - INFO - Chain [1] done processing
03:09:25 - cmdstanpy - INFO - Chain [1] done processing
03:09:26 - cmdstanpy - INFO - Chain [1] done processing
03:09:26 - cmdstanpy - INFO - Chain [1] start processing
03:09:26 - cmdstanpy - INFO - Chain [1] done processing
03:09:27 - cmdstanpy - INFO - Chain [1] start processing
03:09:27 - cmdstanpy - INFO - Chain [1] start processing
03:09:27 - cmdstanpy - INFO - Chain [1] start processing
03:09:27 - cmdstanpy - INFO - Chain [1] start processing
03:09:27 - cmdstanpy - INFO - Chain [1] done processing
03:09:27 - cmdstanpy - INFO - Chain [1] done processing
03:09:27 - cmdstanpy - INFO - Chain [1] done processing
03:09:28 - cmdstanpy - INFO - Chain [1] done processing
03:09:28 - cmdstanpy - INFO - Chain [1] start processing
03:09:28 - cmdstanpy - INFO - Chain [1] done processing
03:09:29 - cmdstanpy - INFO - Chain [1] start processing
03:09:29 - cmdstanpy - INFO - Chain [1] start processing
03:09:29 - cmdstanpy - INFO - Chain [1] start processing
03:09:29 - cmdstanpy - INFO - Chain [1] start processing
03:09:29 - cmdstanpy - INFO - Chain [1] done processing
03:09:29 - cmdstanpy - INFO - Chain [1] done processing
03:09:29 - cmdstanpy - INFO - Chain [1] done processing
03:09:30 - cmdstanpy - INFO - Chain [1] done processing
03:09:30 - cmdstanpy - INFO - Chain [1] start processing
03:09:30 - cmdstanpy - INFO - Chain [1] done processing
03:09:31 - cmdstanpy - INFO - Chain [1] start processing
03:09:31 - cmdstanpy - INFO - Chain [1] start processing
03:09:31 - cmdstanpy - INFO - Chain [1] start processing
03:09:31 - cmdstanpy - INFO - Chain [1] start processing
03:09:31 - cmdstanpy - INFO - Chain [1] done processing
03:09:31 - cmdstanpy - INFO - Chain [1] done processing
03:09:31 - cmdstanpy - INFO - Chain [1] done processing
03:09:32 - cmdstanpy - INFO - Chain [1] done processing
03:09:32 - cmdstanpy - INFO - Chain [1] start processing
03:09:32 - cmdstanpy - INFO - Chain [1] done processing
03:09:33 - cmdstanpy - INFO - Chain [1] start processing
03:09:33 - cmdstanpy - INFO - Chain [1] start processing
03:09:33 - cmdstanpy - INFO - Chain [1] start processing
03:09:33 - cmdstanpy - INFO - Chain [1] start processing
03:09:33 - cmdstanpy - INFO - Chain [1] done processing
03:09:33 - cmdstanpy - INFO - Chain [1] done processing
03:09:33 - cmdstanpy - INFO - Chain [1] done processing
03:09:34 - cmdstanpy - INFO - Chain [1] done processing
03:09:34 - cmdstanpy - INFO - Chain [1] start processing
03:09:35 - cmdstanpy - INFO - Chain [1] done processing
03:09:35 - cmdstanpy - INFO - Chain [1] start processing
03:09:35 - cmdstanpy - INFO - Chain [1] start processing
03:09:35 - cmdstanpy - INFO - Chain [1] start processing
03:09:35 - cmdstanpy - INFO - Chain [1] start processing
03:09:35 - cmdstanpy - INFO - Chain [1] done processing
03:09:36 - cmdstanpy - INFO - Chain [1] done processing
03:09:36 - cmdstanpy - INFO - Chain [1] done processing
03:09:36 - cmdstanpy - INFO - Chain [1] done processing
03:09:36 - cmdstanpy - INFO - Chain [1] start processing
03:09:37 - cmdstanpy - INFO - Chain [1] done processing
03:09:37 - cmdstanpy - INFO - Chain [1] start processing
03:09:37 - cmdstanpy - INFO - Chain [1] start processing
03:09:37 - cmdstanpy - INFO - Chain [1] start processing
03:09:37 - cmdstanpy - INFO - Chain [1] start processing
03:09:37 - cmdstanpy - INFO - Chain [1] done processing
03:09:38 - cmdstanpy - INFO - Chain [1] done processing
03:09:38 - cmdstanpy - INFO - Chain [1] done processing
03:09:38 - cmdstanpy - INFO - Chain [1] done processing
03:09:38 - cmdstanpy - INFO - Chain [1] start processing
03:09:39 - cmdstanpy - INFO - Chain [1] done processing
03:09:39 - cmdstanpy - INFO - Chain [1] start processing
03:09:39 - cmdstanpy - INFO - Chain [1] start processing
03:09:39 - cmdstanpy - INFO - Chain [1] start processing
03:09:39 - cmdstanpy - INFO - Chain [1] start processing
03:09:40 - cmdstanpy - INFO - Chain [1] done processing
03:09:40 - cmdstanpy - INFO - Chain [1] done processing
03:09:40 - cmdstanpy - INFO - Chain [1] done processing
03:09:40 - cmdstanpy - INFO - Chain [1] done processing
03:09:40 - cmdstanpy - INFO - Chain [1] start processing
03:09:41 - cmdstanpy - INFO - Chain [1] done processing
03:09:42 - cmdstanpy - INFO - Chain [1] start processing
03:09:42 - cmdstanpy - INFO - Chain [1] start processing
03:09:42 - cmdstanpy - INFO - Chain [1] start processing
03:09:42 - cmdstanpy - INFO - Chain [1] start processing
03:09:42 - cmdstanpy - INFO - Chain [1] done processing
03:09:42 - cmdstanpy - INFO - Chain [1] done processing
03:09:42 - cmdstanpy - INFO - Chain [1] done processing
03:09:42 - cmdstanpy - INFO - Chain [1] done processing
03:09:42 - cmdstanpy - INFO - Chain [1] start processing
03:09:43 - cmdstanpy - INFO - Chain [1] done processing
03:09:44 - cmdstanpy - INFO - Chain [1] start processing
03:09:44 - cmdstanpy - INFO - Chain [1] start processing
03:09:44 - cmdstanpy - INFO - Chain [1] start processing
03:09:44 - cmdstanpy - INFO - Chain [1] start processing
03:09:44 - cmdstanpy - INFO - Chain [1] done processing
03:09:44 - cmdstanpy - INFO - Chain [1] done processing
03:09:44 - cmdstanpy - INFO - Chain [1] done processing
03:09:44 - cmdstanpy - INFO - Chain [1] done processing
03:09:44 - cmdstanpy - INFO - Chain [1] start processing
03:09:45 - cmdstanpy - INFO - Chain [1] done processing
03:09:46 - cmdstanpy - INFO - Chain [1] start processing
03:09:46 - cmdstanpy - INFO - Chain [1] start processing
03:09:46 - cmdstanpy - INFO - Chain [1] start processing
03:09:46 - cmdstanpy - INFO - Chain [1] start processing
03:09:46 - cmdstanpy - INFO - Chain [1] done processing
03:09:46 - cmdstanpy - INFO - Chain [1] done processing
03:09:46 - cmdstanpy - INFO - Chain [1] done processing
03:09:46 - cmdstanpy - INFO - Chain [1] done processing
03:09:46 - cmdstanpy - INFO - Chain [1] start processing
03:09:47 - cmdstanpy - INFO - Chain [1] done processing
03:09:48 - cmdstanpy - INFO - Chain [1] start processing
03:09:48 - cmdstanpy - INFO - Chain [1] start processing
03:09:48 - cmdstanpy - INFO - Chain [1] start processing
03:09:48 - cmdstanpy - INFO - Chain [1] start processing
03:09:48 - cmdstanpy - INFO - Chain [1] done processing
03:09:48 - cmdstanpy - INFO - Chain [1] done processing
03:09:48 - cmdstanpy - INFO - Chain [1] done processing
03:09:48 - cmdstanpy - INFO - Chain [1] done processing
03:09:48 - cmdstanpy - INFO - Chain [1] start processing
03:09:49 - cmdstanpy - INFO - Chain [1] done processing
03:09:50 - cmdstanpy - INFO - Chain [1] start processing
03:09:50 - cmdstanpy - INFO - Chain [1] start processing
03:09:50 - cmdstanpy - INFO - Chain [1] start processing
03:09:50 - cmdstanpy - INFO - Chain [1] start processing
03:09:50 - cmdstanpy - INFO - Chain [1] done processing
03:09:50 - cmdstanpy - INFO - Chain [1] done processing
03:09:50 - cmdstanpy - INFO - Chain [1] done processing
03:09:51 - cmdstanpy - INFO - Chain [1] done processing
03:09:51 - cmdstanpy - INFO - Chain [1] start processing
03:09:51 - cmdstanpy - INFO - Chain [1] done processing
03:09:52 - cmdstanpy - INFO - Chain [1] start processing
03:09:52 - cmdstanpy - INFO - Chain [1] start processing
03:09:52 - cmdstanpy - INFO - Chain [1] start processing
03:09:52 - cmdstanpy - INFO - Chain [1] start processing
03:09:52 - cmdstanpy - INFO - Chain [1] done processing
03:09:52 - cmdstanpy - INFO - Chain [1] done processing
03:09:52 - cmdstanpy - INFO - Chain [1] done processing
03:09:53 - cmdstanpy - INFO - Chain [1] done processing
03:09:53 - cmdstanpy - INFO - Chain [1] start processing
03:09:53 - cmdstanpy - INFO - Chain [1] done processing
03:09:54 - cmdstanpy - INFO - Chain [1] start processing
03:09:54 - cmdstanpy - INFO - Chain [1] start processing
03:09:54 - cmdstanpy - INFO - Chain [1] start processing
03:09:54 - cmdstanpy - INFO - Chain [1] start processing
03:09:54 - cmdstanpy - INFO - Chain [1] done processing
03:09:54 - cmdstanpy - INFO - Chain [1] done processing
03:09:54 - cmdstanpy - INFO - Chain [1] done processing
03:09:55 - cmdstanpy - INFO - Chain [1] done processing
03:09:55 - cmdstanpy - INFO - Chain [1] start processing
03:09:55 - cmdstanpy - INFO - Chain [1] done processing
03:09:56 - cmdstanpy - INFO - Chain [1] start processing
03:09:56 - cmdstanpy - INFO - Chain [1] start processing
03:09:56 - cmdstanpy - INFO - Chain [1] start processing
03:09:56 - cmdstanpy - INFO - Chain [1] start processing
03:09:56 - cmdstanpy - INFO - Chain [1] done processing
03:09:56 - cmdstanpy - INFO - Chain [1] done processing
03:09:56 - cmdstanpy - INFO - Chain [1] done processing
03:09:57 - cmdstanpy - INFO - Chain [1] done processing
03:09:57 - cmdstanpy - INFO - Chain [1] start processing
03:09:58 - cmdstanpy - INFO - Chain [1] done processing
03:09:59 - cmdstanpy - INFO - Chain [1] start processing
03:09:59 - cmdstanpy - INFO - Chain [1] start processing
03:09:59 - cmdstanpy - INFO - Chain [1] start processing
03:09:59 - cmdstanpy - INFO - Chain [1] start processing
03:09:59 - cmdstanpy - INFO - Chain [1] done processing
03:09:59 - cmdstanpy - INFO - Chain [1] done processing
03:09:59 - cmdstanpy - INFO - Chain [1] done processing
03:09:59 - cmdstanpy - INFO - Chain [1] done processing
03:09:59 - cmdstanpy - INFO - Chain [1] start processing
03:10:00 - cmdstanpy - INFO - Chain [1] done processing
03:10:01 - cmdstanpy - INFO - Chain [1] start processing
03:10:01 - cmdstanpy - INFO - Chain [1] start processing
03:10:01 - cmdstanpy - INFO - Chain [1] start processing
03:10:01 - cmdstanpy - INFO - Chain [1] start processing
03:10:01 - cmdstanpy - INFO - Chain [1] done processing
03:10:01 - cmdstanpy - INFO - Chain [1] done processing
03:10:01 - cmdstanpy - INFO - Chain [1] done processing
03:10:01 - cmdstanpy - INFO - Chain [1] done processing
03:10:01 - cmdstanpy - INFO - Chain [1] start processing
03:10:02 - cmdstanpy - INFO - Chain [1] done processing
03:10:03 - cmdstanpy - INFO - Chain [1] start processing
03:10:03 - cmdstanpy - INFO - Chain [1] start processing
03:10:03 - cmdstanpy - INFO - Chain [1] start processing
03:10:03 - cmdstanpy - INFO - Chain [1] start processing
03:10:03 - cmdstanpy - INFO - Chain [1] done processing
03:10:03 - cmdstanpy - INFO - Chain [1] done processing
03:10:03 - cmdstanpy - INFO - Chain [1] done processing
03:10:03 - cmdstanpy - INFO - Chain [1] done processing
03:10:03 - cmdstanpy - INFO - Chain [1] start processing
03:10:04 - cmdstanpy - INFO - Chain [1] done processing
03:10:05 - cmdstanpy - INFO - Chain [1] start processing
03:10:05 - cmdstanpy - INFO - Chain [1] start processing
03:10:05 - cmdstanpy - INFO - Chain [1] start processing
03:10:05 - cmdstanpy - INFO - Chain [1] start processing
03:10:05 - cmdstanpy - INFO - Chain [1] done processing
03:10:05 - cmdstanpy - INFO - Chain [1] done processing
03:10:05 - cmdstanpy - INFO - Chain [1] done processing
03:10:05 - cmdstanpy - INFO - Chain [1] done processing
03:10:05 - cmdstanpy - INFO - Chain [1] start processing
03:10:06 - cmdstanpy - INFO - Chain [1] done processing
03:10:07 - cmdstanpy - INFO - Chain [1] start processing
03:10:07 - cmdstanpy - INFO - Chain [1] start processing
03:10:07 - cmdstanpy - INFO - Chain [1] start processing
03:10:07 - cmdstanpy - INFO - Chain [1] start processing
03:10:07 - cmdstanpy - INFO - Chain [1] done processing
03:10:07 - cmdstanpy - INFO - Chain [1] done processing
03:10:08 - cmdstanpy - INFO - Chain [1] done processing
03:10:08 - cmdstanpy - INFO - Chain [1] done processing
03:10:08 - cmdstanpy - INFO - Chain [1] start processing
03:10:08 - cmdstanpy - INFO - Chain [1] done processing
03:10:09 - cmdstanpy - INFO - Chain [1] start processing
03:10:09 - cmdstanpy - INFO - Chain [1] start processing
03:10:09 - cmdstanpy - INFO - Chain [1] start processing
03:10:09 - cmdstanpy - INFO - Chain [1] start processing
03:10:09 - cmdstanpy - INFO - Chain [1] done processing
03:10:10 - cmdstanpy - INFO - Chain [1] done processing
03:10:10 - cmdstanpy - INFO - Chain [1] done processing
03:10:10 - cmdstanpy - INFO - Chain [1] done processing
03:10:10 - cmdstanpy - INFO - Chain [1] start processing
03:10:11 - cmdstanpy - INFO - Chain [1] done processing
03:10:11 - cmdstanpy - INFO - Chain [1] start processing
03:10:11 - cmdstanpy - INFO - Chain [1] start processing
03:10:11 - cmdstanpy - INFO - Chain [1] start processing
03:10:12 - cmdstanpy - INFO - Chain [1] start processing
03:10:12 - cmdstanpy - INFO - Chain [1] done processing
03:10:12 - cmdstanpy - INFO - Chain [1] done processing
03:10:12 - cmdstanpy - INFO - Chain [1] done processing
03:10:12 - cmdstanpy - INFO - Chain [1] done processing
03:10:12 - cmdstanpy - INFO - Chain [1] start processing
03:10:13 - cmdstanpy - INFO - Chain [1] done processing
03:10:14 - cmdstanpy - INFO - Chain [1] start processing
03:10:14 - cmdstanpy - INFO - Chain [1] start processing
03:10:14 - cmdstanpy - INFO - Chain [1] start processing
03:10:14 - cmdstanpy - INFO - Chain [1] start processing
03:10:14 - cmdstanpy - INFO - Chain [1] done processing
03:10:14 - cmdstanpy - INFO - Chain [1] done processing
03:10:14 - cmdstanpy - INFO - Chain [1] done processing
03:10:14 - cmdstanpy - INFO - Chain [1] done processing
03:10:14 - cmdstanpy - INFO - Chain [1] start processing
03:10:15 - cmdstanpy - INFO - Chain [1] done processing
03:10:16 - cmdstanpy - INFO - Chain [1] start processing
03:10:16 - cmdstanpy - INFO - Chain [1] start processing
03:10:16 - cmdstanpy - INFO - Chain [1] start processing
03:10:16 - cmdstanpy - INFO - Chain [1] start processing
03:10:16 - cmdstanpy - INFO - Chain [1] done processing
03:10:16 - cmdstanpy - INFO - Chain [1] done processing
03:10:16 - cmdstanpy - INFO - Chain [1] done processing
03:10:16 - cmdstanpy - INFO - Chain [1] done processing
03:10:16 - cmdstanpy - INFO - Chain [1] start processing
03:10:17 - cmdstanpy - INFO - Chain [1] done processing
03:10:18 - cmdstanpy - INFO - Chain [1] start processing
03:10:18 - cmdstanpy - INFO - Chain [1] start processing
03:10:18 - cmdstanpy - INFO - Chain [1] start processing
03:10:18 - cmdstanpy - INFO - Chain [1] start processing
03:10:18 - cmdstanpy - INFO - Chain [1] done processing
03:10:18 - cmdstanpy - INFO - Chain [1] done processing
03:10:18 - cmdstanpy - INFO - Chain [1] done processing
03:10:18 - cmdstanpy - INFO - Chain [1] done processing
03:10:18 - cmdstanpy - INFO - Chain [1] start processing
03:10:19 - cmdstanpy - INFO - Chain [1] done processing
03:10:20 - cmdstanpy - INFO - Chain [1] start processing
03:10:20 - cmdstanpy - INFO - Chain [1] start processing
03:10:20 - cmdstanpy - INFO - Chain [1] start processing
03:10:20 - cmdstanpy - INFO - Chain [1] start processing
03:10:20 - cmdstanpy - INFO - Chain [1] done processing
03:10:20 - cmdstanpy - INFO - Chain [1] done processing
03:10:20 - cmdstanpy - INFO - Chain [1] done processing
03:10:20 - cmdstanpy - INFO - Chain [1] done processing
03:10:20 - cmdstanpy - INFO - Chain [1] start processing
03:10:21 - cmdstanpy - INFO - Chain [1] done processing
03:10:22 - cmdstanpy - INFO - Chain [1] start processing
03:10:22 - cmdstanpy - INFO - Chain [1] start processing
03:10:22 - cmdstanpy - INFO - Chain [1] start processing
03:10:22 - cmdstanpy - INFO - Chain [1] start processing
03:10:22 - cmdstanpy - INFO - Chain [1] done processing
03:10:22 - cmdstanpy - INFO - Chain [1] done processing
03:10:22 - cmdstanpy - INFO - Chain [1] done processing
03:10:22 - cmdstanpy - INFO - Chain [1] done processing
03:10:22 - cmdstanpy - INFO - Chain [1] start processing
03:10:23 - cmdstanpy - INFO - Chain [1] done processing
03:10:24 - cmdstanpy - INFO - Chain [1] start processing
03:10:24 - cmdstanpy - INFO - Chain [1] start processing
03:10:24 - cmdstanpy - INFO - Chain [1] start processing
03:10:24 - cmdstanpy - INFO - Chain [1] start processing
03:10:24 - cmdstanpy - INFO - Chain [1] done processing
03:10:24 - cmdstanpy - INFO - Chain [1] done processing
03:10:24 - cmdstanpy - INFO - Chain [1] done processing
03:10:25 - cmdstanpy - INFO - Chain [1] done processing
03:10:25 - cmdstanpy - INFO - Chain [1] start processing
03:10:25 - cmdstanpy - INFO - Chain [1] done processing
03:10:26 - cmdstanpy - INFO - Chain [1] start processing
03:10:26 - cmdstanpy - INFO - Chain [1] start processing
03:10:26 - cmdstanpy - INFO - Chain [1] start processing
03:10:26 - cmdstanpy - INFO - Chain [1] start processing
03:10:26 - cmdstanpy - INFO - Chain [1] done processing
03:10:26 - cmdstanpy - INFO - Chain [1] done processing
03:10:26 - cmdstanpy - INFO - Chain [1] done processing
03:10:27 - cmdstanpy - INFO - Chain [1] done processing
03:10:27 - cmdstanpy - INFO - Chain [1] start processing
03:10:28 - cmdstanpy - INFO - Chain [1] done processing
03:10:28 - cmdstanpy - INFO - Chain [1] start processing
03:10:28 - cmdstanpy - INFO - Chain [1] start processing
03:10:28 - cmdstanpy - INFO - Chain [1] start processing
03:10:28 - cmdstanpy - INFO - Chain [1] start processing
03:10:28 - cmdstanpy - INFO - Chain [1] done processing
03:10:29 - cmdstanpy - INFO - Chain [1] done processing
03:10:29 - cmdstanpy - INFO - Chain [1] done processing
03:10:29 - cmdstanpy - INFO - Chain [1] done processing
03:10:29 - cmdstanpy - INFO - Chain [1] start processing
03:10:30 - cmdstanpy - INFO - Chain [1] done processing
03:10:30 - cmdstanpy - INFO - Chain [1] start processing
03:10:30 - cmdstanpy - INFO - Chain [1] start processing
03:10:30 - cmdstanpy - INFO - Chain [1] start processing
03:10:30 - cmdstanpy - INFO - Chain [1] start processing
03:10:30 - cmdstanpy - INFO - Chain [1] done processing
03:10:31 - cmdstanpy - INFO - Chain [1] done processing
03:10:31 - cmdstanpy - INFO - Chain [1] done processing
03:10:31 - cmdstanpy - INFO - Chain [1] done processing
03:10:31 - cmdstanpy - INFO - Chain [1] start processing
03:10:32 - cmdstanpy - INFO - Chain [1] done processing
03:10:32 - cmdstanpy - INFO - Chain [1] start processing
03:10:32 - cmdstanpy - INFO - Chain [1] start processing
03:10:32 - cmdstanpy - INFO - Chain [1] start processing
03:10:32 - cmdstanpy - INFO - Chain [1] start processing
03:10:33 - cmdstanpy - INFO - Chain [1] done processing
03:10:33 - cmdstanpy - INFO - Chain [1] done processing
03:10:33 - cmdstanpy - INFO - Chain [1] done processing
03:10:33 - cmdstanpy - INFO - Chain [1] done processing
03:10:33 - cmdstanpy - INFO - Chain [1] start processing
03:10:34 - cmdstanpy - INFO - Chain [1] done processing
03:10:35 - cmdstanpy - INFO - Chain [1] start processing
03:10:35 - cmdstanpy - INFO - Chain [1] start processing
03:10:35 - cmdstanpy - INFO - Chain [1] start processing
03:10:35 - cmdstanpy - INFO - Chain [1] start processing
03:10:35 - cmdstanpy - INFO - Chain [1] done processing
03:10:35 - cmdstanpy - INFO - Chain [1] done processing
03:10:35 - cmdstanpy - INFO - Chain [1] done processing
03:10:35 - cmdstanpy - INFO - Chain [1] done processing
03:10:35 - cmdstanpy - INFO - Chain [1] start processing
03:10:36 - cmdstanpy - INFO - Chain [1] done processing
03:10:37 - cmdstanpy - INFO - Chain [1] start processing
03:10:37 - cmdstanpy - INFO - Chain [1] start processing
03:10:37 - cmdstanpy - INFO - Chain [1] start processing
03:10:37 - cmdstanpy - INFO - Chain [1] start processing
03:10:37 - cmdstanpy - INFO - Chain [1] done processing
03:10:37 - cmdstanpy - INFO - Chain [1] done processing
03:10:37 - cmdstanpy - INFO - Chain [1] done processing
03:10:37 - cmdstanpy - INFO - Chain [1] done processing
03:10:37 - cmdstanpy - INFO - Chain [1] start processing
03:10:38 - cmdstanpy - INFO - Chain [1] done processing
03:10:39 - cmdstanpy - INFO - Chain [1] start processing
03:10:39 - cmdstanpy - INFO - Chain [1] start processing
03:10:39 - cmdstanpy - INFO - Chain [1] start processing
03:10:39 - cmdstanpy - INFO - Chain [1] start processing
03:10:39 - cmdstanpy - INFO - Chain [1] done processing
03:10:39 - cmdstanpy - INFO - Chain [1] done processing
03:10:39 - cmdstanpy - INFO - Chain [1] done processing
03:10:39 - cmdstanpy - INFO - Chain [1] done processing
03:10:40 - cmdstanpy - INFO - Chain [1] start processing
03:10:40 - cmdstanpy - INFO - Chain [1] done processing
03:10:41 - cmdstanpy - INFO - Chain [1] start processing
03:10:41 - cmdstanpy - INFO - Chain [1] start processing
03:10:41 - cmdstanpy - INFO - Chain [1] start processing
03:10:41 - cmdstanpy - INFO - Chain [1] start processing
03:10:41 - cmdstanpy - INFO - Chain [1] done processing
03:10:42 - cmdstanpy - INFO - Chain [1] done processing
03:10:42 - cmdstanpy - INFO - Chain [1] done processing
03:10:42 - cmdstanpy - INFO - Chain [1] done processing
03:10:42 - cmdstanpy - INFO - Chain [1] start processing
03:10:43 - cmdstanpy - INFO - Chain [1] done processing
03:10:43 - cmdstanpy - INFO - Chain [1] start processing
03:10:43 - cmdstanpy - INFO - Chain [1] start processing
03:10:43 - cmdstanpy - INFO - Chain [1] start processing
03:10:43 - cmdstanpy - INFO - Chain [1] start processing
03:10:43 - cmdstanpy - INFO - Chain [1] done processing
03:10:44 - cmdstanpy - INFO - Chain [1] done processing
03:10:44 - cmdstanpy - INFO - Chain [1] done processing
03:10:44 - cmdstanpy - INFO - Chain [1] done processing
03:10:44 - cmdstanpy - INFO - Chain [1] start processing
03:10:45 - cmdstanpy - INFO - Chain [1] done processing
03:10:46 - cmdstanpy - INFO - Chain [1] start processing
03:10:46 - cmdstanpy - INFO - Chain [1] start processing
03:10:46 - cmdstanpy - INFO - Chain [1] start processing
03:10:46 - cmdstanpy - INFO - Chain [1] start processing
03:10:46 - cmdstanpy - INFO - Chain [1] done processing
03:10:46 - cmdstanpy - INFO - Chain [1] done processing
03:10:46 - cmdstanpy - INFO - Chain [1] done processing
03:10:46 - cmdstanpy - INFO - Chain [1] done processing
03:10:46 - cmdstanpy - INFO - Chain [1] start processing
03:10:47 - cmdstanpy - INFO - Chain [1] done processing
03:10:48 - cmdstanpy - INFO - Chain [1] start processing
03:10:48 - cmdstanpy - INFO - Chain [1] start processing
03:10:48 - cmdstanpy - INFO - Chain [1] start processing
03:10:48 - cmdstanpy - INFO - Chain [1] start processing
03:10:48 - cmdstanpy - INFO - Chain [1] done processing
03:10:48 - cmdstanpy - INFO - Chain [1] done processing
03:10:48 - cmdstanpy - INFO - Chain [1] done processing
03:10:48 - cmdstanpy - INFO - Chain [1] done processing
03:10:48 - cmdstanpy - INFO - Chain [1] start processing
03:10:49 - cmdstanpy - INFO - Chain [1] done processing
03:10:50 - cmdstanpy - INFO - Chain [1] start processing
03:10:50 - cmdstanpy - INFO - Chain [1] start processing
03:10:50 - cmdstanpy - INFO - Chain [1] start processing
03:10:50 - cmdstanpy - INFO - Chain [1] start processing
03:10:50 - cmdstanpy - INFO - Chain [1] done processing
03:10:50 - cmdstanpy - INFO - Chain [1] done processing
03:10:50 - cmdstanpy - INFO - Chain [1] done processing
03:10:51 - cmdstanpy - INFO - Chain [1] done processing
03:10:51 - cmdstanpy - INFO - Chain [1] start processing
03:10:51 - cmdstanpy - INFO - Chain [1] done processing
03:10:52 - cmdstanpy - INFO - Chain [1] start processing
03:10:52 - cmdstanpy - INFO - Chain [1] start processing
03:10:52 - cmdstanpy - INFO - Chain [1] start processing
03:10:52 - cmdstanpy - INFO - Chain [1] start processing
03:10:52 - cmdstanpy - INFO - Chain [1] done processing
03:10:52 - cmdstanpy - INFO - Chain [1] done processing
03:10:53 - cmdstanpy - INFO - Chain [1] done processing
03:10:53 - cmdstanpy - INFO - Chain [1] done processing
03:10:53 - cmdstanpy - INFO - Chain [1] start processing
03:10:53 - cmdstanpy - INFO - Chain [1] done processing
03:10:54 - cmdstanpy - INFO - Chain [1] start processing
03:10:54 - cmdstanpy - INFO - Chain [1] start processing
03:10:54 - cmdstanpy - INFO - Chain [1] start processing
03:10:54 - cmdstanpy - INFO - Chain [1] start processing
03:10:54 - cmdstanpy - INFO - Chain [1] done processing
03:10:55 - cmdstanpy - INFO - Chain [1] done processing
03:10:55 - cmdstanpy - INFO - Chain [1] done processing
03:10:55 - cmdstanpy - INFO - Chain [1] done processing
03:10:55 - cmdstanpy - INFO - Chain [1] start processing
03:10:56 - cmdstanpy - INFO - Chain [1] done processing
03:10:57 - cmdstanpy - INFO - Chain [1] start processing
03:10:57 - cmdstanpy - INFO - Chain [1] start processing
03:10:57 - cmdstanpy - INFO - Chain [1] start processing
03:10:57 - cmdstanpy - INFO - Chain [1] start processing
03:10:57 - cmdstanpy - INFO - Chain [1] done processing
03:10:57 - cmdstanpy - INFO - Chain [1] done processing
03:10:57 - cmdstanpy - INFO - Chain [1] done processing
03:10:57 - cmdstanpy - INFO - Chain [1] done processing
03:10:57 - cmdstanpy - INFO - Chain [1] start processing
03:10:58 - cmdstanpy - INFO - Chain [1] done processing
03:10:59 - cmdstanpy - INFO - Chain [1] start processing
03:10:59 - cmdstanpy - INFO - Chain [1] start processing
03:10:59 - cmdstanpy - INFO - Chain [1] start processing
03:10:59 - cmdstanpy - INFO - Chain [1] start processing
03:10:59 - cmdstanpy - INFO - Chain [1] done processing
03:10:59 - cmdstanpy - INFO - Chain [1] done processing
03:10:59 - cmdstanpy - INFO - Chain [1] done processing
03:10:59 - cmdstanpy - INFO - Chain [1] done processing
03:10:59 - cmdstanpy - INFO - Chain [1] start processing
03:11:00 - cmdstanpy - INFO - Chain [1] done processing
03:11:01 - cmdstanpy - INFO - Chain [1] start processing
03:11:01 - cmdstanpy - INFO - Chain [1] start processing
03:11:01 - cmdstanpy - INFO - Chain [1] start processing
03:11:01 - cmdstanpy - INFO - Chain [1] start processing
03:11:01 - cmdstanpy - INFO - Chain [1] done processing
03:11:01 - cmdstanpy - INFO - Chain [1] done processing
03:11:02 - cmdstanpy - INFO - Chain [1] done processing
03:11:02 - cmdstanpy - INFO - Chain [1] done processing
03:11:02 - cmdstanpy - INFO - Chain [1] start processing
03:11:02 - cmdstanpy - INFO - Chain [1] done processing
03:11:03 - cmdstanpy - INFO - Chain [1] start processing
03:11:03 - cmdstanpy - INFO - Chain [1] start processing
03:11:03 - cmdstanpy - INFO - Chain [1] start processing
03:11:03 - cmdstanpy - INFO - Chain [1] start processing
03:11:03 - cmdstanpy - INFO - Chain [1] done processing
03:11:04 - cmdstanpy - INFO - Chain [1] done processing
03:11:04 - cmdstanpy - INFO - Chain [1] done processing
03:11:04 - cmdstanpy - INFO - Chain [1] done processing
03:11:04 - cmdstanpy - INFO - Chain [1] start processing
03:11:05 - cmdstanpy - INFO - Chain [1] done processing
03:11:06 - cmdstanpy - INFO - Chain [1] start processing
03:11:06 - cmdstanpy - INFO - Chain [1] start processing
03:11:06 - cmdstanpy - INFO - Chain [1] start processing
03:11:06 - cmdstanpy - INFO - Chain [1] start processing
03:11:06 - cmdstanpy - INFO - Chain [1] done processing
03:11:06 - cmdstanpy - INFO - Chain [1] done processing
03:11:06 - cmdstanpy - INFO - Chain [1] done processing
03:11:06 - cmdstanpy - INFO - Chain [1] done processing
03:11:06 - cmdstanpy - INFO - Chain [1] start processing
Best parameters: {'changepoint_prior_scale': 0.45, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.015}
03:11:07 - cmdstanpy - INFO - Chain [1] done processing
Test RMSE: 0.01312851228058226
03:11:08 - cmdstanpy - INFO - Chain [1] start processing
03:11:08 - cmdstanpy - INFO - Chain [1] start processing
03:11:08 - cmdstanpy - INFO - Chain [1] start processing
03:11:08 - cmdstanpy - INFO - Chain [1] start processing
03:11:08 - cmdstanpy - INFO - Chain [1] done processing
03:11:08 - cmdstanpy - INFO - Chain [1] done processing
03:11:08 - cmdstanpy - INFO - Chain [1] done processing
Cross-Validation RMSE: 0.005042699595181557
03:11:08 - cmdstanpy - INFO - Chain [1] done processing

Since I exhaustively tuned the hyperparameters that are meant to be tuned, I feel confident that these parameter values will lead to the lowest RMSE for a Prophet model trained on my data. The final parameter values I got are:

Best parameters: {'changepoint_prior_scale': 0.45, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.015, 'seasonality_mode': 'additive'}

A 'changepoint_prior_scale' of 0.45 means that the model has just under the maximum trend flexibility, whereas a 'seasonality_prior_scale' of 0.01 indicates the minimum amount of seasonality flexibility meaning that the magnitude of the parameter is shrunken with maximum regularization, and a 'holidays_prior_scale' of 0.015 means the same but for holidays flexibility. Finally, 'seasonality_mode' of 'additive' is the default which means that the seasonal effects are added as opposed to multiplied to make the final forecast and seasonal fluctuations are constant over time.

The biggest issue I had was a relatively high RMSE; however, setting growth = 'logistic' (at the suggestion of my teammate Kaylee Mo) vastly improved my results.

1.3.3.3 3. Model Performance

Below are the results of the best Prophet univariate model after tuning. Although this model’s RMSE is higher than the best ARIMA model I could make, the results make more sense in that the test RMSE is higher than the train’s. There is evidence of overfitting as the test RMSE is around 10 times as high as the train’s. However, the cross-validated RMSE is much closer than to the train RMSE.

As for the cross-validation performance across horizons, the RMSE remains fairly consistently small. This indicates stable model performance over time. The high coverages may suggest that the prediction intervals are too wide and missing values due to the lack of precision (Schmudde, 2019).

Looking at the residual plots, one can see that they fluctuate between approximately -0.0125 and 0.0075 indicating that the model is not consistently solely under or overestimating the predictions. Furthermore, since the residuals oscillate around 0, there is no clear positive nor negative bias which indicates that the model does not overpredict or underpredict systematically. There are no clear trends or seasonality in the residuals, and there are two outlying points at around December 2021 and late June 2022.

Overall, the Prophet univariate model is among one of the best that I have created despite there being some evidence of lack of prediction precisions. Furthermore, although initially I thought there was a lot of evidence of overfitting, after seeing the cross-validation results, I believe the overfitting is only slight.

Code
# Initialize the Prophet model with the given parameters
model = Prophet(changepoint_prior_scale=0.45,
                seasonality_prior_scale=0.01,
                holidays_prior_scale=0.015,
                seasonality_mode='additive')

# Fit the model with the training data
model.fit(train)

# Make predictions on the training set
train_pred = model.predict(train[['ds']])

# Make predictions on the test set
test_pred = model.predict(test[['ds']])

# Calculate RMSE for training and test sets
train_rmse = sqrt(mean_squared_error(train['y'], train_pred['yhat']))
test_rmse = sqrt(mean_squared_error(test['y'], test_pred['yhat']))

# Output the RMSE values
print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")

# Plot the predictions against actuals for the training set
plt.figure(figsize=(10, 5))
plt.plot(train['ds'], train['y'], label='Actual')
plt.plot(train['ds'], train_pred['yhat'], label='Predicted')
plt.title('Training Data: Actual vs Predicted')
plt.legend()
plt.show()

# Plot the predictions against actuals for the test set
plt.figure(figsize=(10, 5))
plt.plot(test['ds'], test['y'], label='Actual')
plt.plot(test['ds'], test_pred['yhat'], label='Predicted')
plt.title('Test Data: Actual vs Predicted')
plt.legend()
plt.show()
03:13:26 - cmdstanpy - INFO - Chain [1] start processing
03:13:26 - cmdstanpy - INFO - Chain [1] done processing
Train RMSE: 0.0020465598500806034
Test RMSE: 0.02662921409495521

Code
# Perform cross-validation
df_cv = cross_validation(model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate performance metrics
df_p = performance_metrics(df_cv)

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')

df_p
03:13:38 - cmdstanpy - INFO - Chain [1] start processing
03:13:38 - cmdstanpy - INFO - Chain [1] start processing
03:13:38 - cmdstanpy - INFO - Chain [1] start processing
03:13:38 - cmdstanpy - INFO - Chain [1] start processing
03:13:38 - cmdstanpy - INFO - Chain [1] done processing
03:13:39 - cmdstanpy - INFO - Chain [1] done processing
03:13:39 - cmdstanpy - INFO - Chain [1] done processing
03:13:39 - cmdstanpy - INFO - Chain [1] done processing
Cross-Validation RMSE: 0.00866195901362708
horizon mse rmse mae mape mdape smape coverage
0 3 days 0.000002 0.001330 0.001322 0.001431 0.001431 0.001432 1.0
1 5 days 0.000002 0.001525 0.001524 0.001699 0.001699 0.001699 1.0
2 6 days 0.000012 0.003434 0.003087 0.003402 0.003402 0.003395 0.5
3 9 days 0.000012 0.003405 0.003021 0.003282 0.003282 0.003275 0.5
4 10 days 0.000003 0.001831 0.001798 0.001936 0.001936 0.001936 1.0
5 12 days 0.000005 0.002190 0.002189 0.002426 0.002426 0.002426 1.0
6 13 days 0.000031 0.005583 0.004903 0.005377 0.005377 0.005358 1.0
7 16 days 0.000036 0.005970 0.005653 0.006137 0.006137 0.006116 1.0
8 17 days 0.000014 0.003778 0.003778 0.004063 0.004063 0.004063 1.0
9 19 days 0.000011 0.003337 0.003295 0.003604 0.003604 0.003605 1.0
10 20 days 0.000057 0.007532 0.006527 0.007130 0.007130 0.007097 1.0
11 23 days 0.000081 0.008975 0.008861 0.009611 0.009611 0.009564 1.0
12 24 days 0.000045 0.006737 0.006696 0.007193 0.007193 0.007186 1.0
13 26 days 0.000028 0.005260 0.005206 0.005670 0.005670 0.005673 1.0
14 27 days 0.000085 0.009231 0.008363 0.009138 0.009138 0.009088 1.0
15 30 days 0.000134 0.011555 0.011531 0.012479 0.012479 0.012401 1.0
16 31 days 0.000086 0.009254 0.009098 0.009751 0.009751 0.009731 1.0
17 33 days 0.000088 0.009399 0.009222 0.010029 0.010029 0.010082 1.0
18 34 days 0.000158 0.012557 0.012474 0.013614 0.013614 0.013597 1.0
19 37 days 0.000204 0.014283 0.014278 0.015417 0.015417 0.015298 1.0
20 38 days 0.000141 0.011882 0.011441 0.012249 0.012249 0.012204 1.0
21 40 days 0.000069 0.008316 0.008315 0.008952 0.008952 0.008993 1.0
22 41 days 0.000135 0.011598 0.011243 0.012182 0.012182 0.012148 1.0
23 44 days 0.000257 0.016038 0.015932 0.017144 0.017144 0.016997 1.0
24 45 days 0.000207 0.014377 0.013824 0.014742 0.014742 0.014676 1.0
Code
# Defining residuals
forecast['residuals'] = train['y'] - forecast['yhat']

# Plotting residuals
plt.figure(figsize=(10, 6))
plt.plot(forecast['ds'], forecast['residuals'])
plt.title('Residuals over Time')
plt.xlabel('Date')
plt.ylabel('Residuals')
plt.axhline(y=0, color='r', linestyle='-')  # Zero line for reference
plt.show()

1.3.4 D. Prophet (Multivariate) Model

1.3.4.1 1. Data Preparation:

My data preparation is pretty similar to the univariate Prophet model. The largest differences were that I dropped the holidays column as it conflicted with the holiday aspect of the Prophet model (it inherently takes into account holidays). I added some additional lag columns and rolling statistics for extra time-series data. For these columns, I used a combination of forwards and backwards fill to impute the missing values. Finally, I scaled the data to a scale from 0 to 1 as I have for all the other models for comparison purposes and renamed the Date and response variable columns for compatibility with Prophet.

To identify the most significant predictors, I plan to initially train a model utilizing the entire set of predictors. I then will analyze the feature importance by examining the corresponding coefficients in the Prophet model. Specifically, I will select those predictors whose coefficients fall within or above the 90th percentile. This approach will be complemented by incorporating my custom-engineered features, ensuring a comprehensive and robust model.

Code
# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime
df['Date'] = pd.to_datetime(df['Date'])

# Sort by 'Date' and 'Location'
df = df.sort_values(by=['Date', 'Location'])

# Drop holidays column as it conflicts
df = df.drop(columns=['holidays'])

# Set Date as the index
df.set_index('Date', inplace=True)

# Only include numeric columns for grouping and mean calculation
numeric_cols = df.select_dtypes(include='number').columns
df_numeric = df[numeric_cols].groupby(df.index).mean()

# Merge the numeric data with the non-numeric data
df_non_numeric = df[df.columns.difference(numeric_cols)].groupby(df.index).first()
df_merged = pd.concat([df_non_numeric, df_numeric], axis=1)

# Additional time-series columns to account for 3-month pattern
pred_var = 'Additional_Doses_Vax_Pct'
df_merged['Additional_Doses_Vax_Pct_3_m_lag'] = df_merged[pred_var].shift(12)
df_merged['Additional_Doses_Vax_Pct_9_m_lag'] = df_merged[pred_var].shift(36)

# Rolling statistics
df_merged['rolling_mean'] = df_merged[pred_var].rolling(window=12).mean()
df_merged['rolling_std'] = df_merged[pred_var].rolling(window=12).std()

# Forward and backwards fill to impute missing values
df_merged.fillna(method='ffill', inplace=True)
df_merged.fillna(method='bfill', inplace=True)

# Update numeric_cols to include the new columns
numeric_cols_updated = df_merged.select_dtypes(include='number').columns

# Initialize MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to all relevant numeric data
scaled_data = min_max_scaler.fit_transform(df_merged[numeric_cols_updated])
df_scaled = pd.DataFrame(scaled_data, columns=numeric_cols_updated, index=df_merged.index)

# Reset index and rename columns for Prophet
df_prophet = df_scaled.reset_index().rename(columns={'Date': 'ds', pred_var: 'y'})

1.3.4.2 2. Model Building

To build my model, I started by splitting my dataset into 70% training data and 30% testing data. I then initialized and fit the prophet model on all of the regressors in my dataset. I then make predictions for the train and test set, ensuring to only pass in the ds column and other regressors and calculate the RMSEs.

There is obvious and severe overfitting in this initial model as the train RMSE is the lowest I have gotten in any model, yet the test RMSE is somehow greater than one despite my scaling the data. Upon plotting, it is revealed that this is because the model is predicting negative values.

Code
# Split into train and test sets
train_size = int(0.7 * len(df_prophet))  # 70% training data, 30% testing data
train = df_prophet[:train_size]
test = df_prophet[train_size:]

# Initialize and fit the Prophet model
model = Prophet()
for col in train.columns:
    if col not in ['ds', 'y']:
        model.add_regressor(col)

model = model.fit(train)
17:14:42 - cmdstanpy - INFO - Chain [1] start processing
17:14:51 - cmdstanpy - INFO - Chain [1] done processing
Code
# Make predictions on the training set
train_predictions = model.predict(train[['ds'] + train.columns.drop(['ds', 'y']).tolist()])
train_rmse = sqrt(mean_squared_error(train['y'], train_predictions['yhat']))

# Make predictions on the test set
test_predictions = model.predict(test[['ds'] + test.columns.drop(['ds', 'y']).tolist()])
test_rmse = sqrt(mean_squared_error(test['y'], test_predictions['yhat']))

print(f'Train RMSE: {train_rmse}')
print(f'Test RMSE: {test_rmse}')
Train RMSE: 6.511725410315001e-05
Test RMSE: 5.234941777275454
Code
# Plotting for training data
plt.figure(figsize=(12, 6))
plt.plot(train['ds'], train['y'], label='Actual')
plt.plot(train['ds'], train_predictions['yhat'], label='Predicted')
plt.title('Training Data: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Value')
plt.legend()
plt.show()

# Plotting for testing data
plt.figure(figsize=(12, 6))
plt.plot(test['ds'], test['y'], label='Actual')
plt.plot(test['ds'], test_predictions['yhat'], label='Predicted')
plt.title('Testing Data: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Value')
plt.legend()
plt.show()

To proceed, I decided to analyze the coefficients of the additional regressors to see which are important. I wanted to simplify my model by just including a few additional features so that I could reduce overfitting. I then found which features have coefficients in or above the 90th percentile of coefficients. I wanted to include the feature engineered columns I made for the rolling statistics and lags as well to increase robustness.

Code
# Extract the coefficients for additional regressors
coefficients = model.params['beta'][0]

# Map the coefficients to the corresponding regressors
regressor_names = [col for col in train.columns if col not in ['ds', 'y']]
coefficient_mapping = dict(zip(regressor_names, coefficients))

# Print the coefficients for each regressor
for regressor, coefficient in coefficient_mapping.items():
    print(f"{regressor}: {coefficient}")
MMWR_week: -17.7126
Distributed: -6.24599
Distributed_Janssen: 0.126586
Distributed_Moderna: 1.10444
Distributed_Pfizer: 1.74047
Distributed_Unk_Manuf: -0.172165
Dist_Per_100K: 5.46868
Distributed_Per_100k_5Plus: -4.95544
Distributed_Per_100k_12Plus: 15.8082
Distributed_Per_100k_18Plus: -11.192
Distributed_Per_100k_65Plus: -1.03975
Administered: -8.12095
Administered_5Plus: 4.14906
Administered_12Plus: 10.0802
Administered_18Plus: 1.31291
Administered_65Plus: -1.03781
Administered_Janssen: -0.372053
Administered_Moderna: 2.28109
Administered_Pfizer: 3.91415
Administered_Unk_Manuf: 0.134152
Admin_Per_100K: 9.96737
Admin_Per_100k_5Plus: -13.0824
Admin_Per_100k_12Plus: -0.199752
Admin_Per_100k_18Plus: 0.643769
Admin_Per_100k_65Plus: 0.440127
Recip_Administered: -13.6794
Administered_Dose1_Pop_Pct: 0.712512
Administered_Dose1_Recip_5PlusPop_Pct: 1.60661
Administered_Dose1_Recip_12PlusPop_Pct: -0.979406
Administered_Dose1_Recip_18PlusPop_Pct: 0.869499
Administered_Dose1_Recip_65PlusPop_Pct: -0.162557
Series_Complete_Pop_Pct: 2.24572
Series_Complete_5PlusPop_Pct: -1.7691
Series_Complete_12PlusPop_Pct: -2.2114
Series_Complete_18PlusPop_Pct: 0.898917
Series_Complete_65PlusPop_Pct: -0.030613
Series_Complete_Janssen: 1.1059
Series_Complete_Moderna: -0.344974
Series_Complete_Pfizer: 0.67971
Series_Complete_Unk_Manuf: -1.66363
Series_Complete_Janssen_12Plus: 2.44106
Series_Complete_Moderna_12Plus: 15.9942
Series_Complete_Pfizer_12Plus: 6.27011
Series_Complete_Unk_Manuf_12Plus: 0.632878
Series_Complete_Janssen_18Plus: -4.04329
Series_Complete_Moderna_18Plus: -14.079
Series_Complete_Pfizer_18Plus: -7.27635
Series_Complete_Unk_Manuf_18Plus: 0.363388
Series_Complete_Janssen_65Plus: 0.440104
Series_Complete_Moderna_65Plus: -0.834406
Series_Complete_Pfizer_65Plus: 0.790656
Series_Complete_Unk_Manuf_65Plus: 0.320233
Additional_Doses_18Plus_Vax_Pct: -3.33052
Additional_Doses_50Plus_Vax_Pct: 5.58217
Additional_Doses_65Plus_Vax_Pct: -0.332158
Additional_Doses_Moderna: 1.88548
Additional_Doses_Pfizer: 0.937175
Additional_Doses_Janssen: -4.39878
Additional_Doses_Unk_Manuf: 0.446367
month: 0.491734
year: 0.443981
quarter: -0.00900019
dayofyear: 7.49538
dayofmonth: 0.0439242
weekofyear: 10.1179
Additional_Doses_Vax_Pct_1_w_lag: -0.102208
Additional_Doses_Vax_Pct_3_m_lag: -0.0442407
Additional_Doses_Vax_Pct_9_m_lag: 0.0214993
rolling_mean: 0.153734
rolling_std: 0.395855
Code
# Given coefficients
coefficients = {
    "MMWR_week": -17.7126,
    "Distributed": -6.24599,
    "Distributed_Janssen": 0.126586,
    "Distributed_Moderna": 1.10444,
    "Distributed_Pfizer": 1.74047,
    "Distributed_Unk_Manuf": -0.172165,
    "Dist_Per_100K": 5.46868,
    "Distributed_Per_100k_5Plus": -4.95544,
    "Distributed_Per_100k_12Plus": 15.8082,
    "Distributed_Per_100k_18Plus": -11.192,
    "Distributed_Per_100k_65Plus": -1.03975,
    "Administered": -8.12095,
    "Administered_5Plus": 4.14906,
    "Administered_12Plus": 10.0802,
    "Administered_18Plus": 1.31291,
    "Administered_65Plus": -1.03781,
    "Administered_Janssen": -0.372053,
    "Administered_Moderna": 2.28109,
    "Administered_Pfizer": 3.91415,
    "Administered_Unk_Manuf": 0.134152,
    "Admin_Per_100K": 9.96737,
    "Admin_Per_100k_5Plus": -13.0824,
    "Admin_Per_100k_12Plus": -0.199752,
    "Admin_Per_100k_18Plus": 0.643769,
    "Admin_Per_100k_65Plus": 0.440127,
    "Recip_Administered": -13.6794,
    "Administered_Dose1_Pop_Pct": 0.712512,
    "Administered_Dose1_Recip_5PlusPop_Pct": 1.60661,
    "Administered_Dose1_Recip_12PlusPop_Pct": -0.979406,
    "Administered_Dose1_Recip_18PlusPop_Pct": 0.869499,
    "Administered_Dose1_Recip_65PlusPop_Pct": -0.162557,
    "Series_Complete_Pop_Pct": 2.24572,
    "Series_Complete_5PlusPop_Pct": -1.7691,
    "Series_Complete_12PlusPop_Pct": -2.2114,
    "Series_Complete_18PlusPop_Pct": 0.898917,
    "Series_Complete_65PlusPop_Pct": -0.030613,
    "Series_Complete_Janssen": 1.1059,
    "Series_Complete_Moderna": -0.344974,
    "Series_Complete_Pfizer": 0.67971,
    "Series_Complete_Unk_Manuf": -1.66363,
    "Series_Complete_Janssen_12Plus": 2.44106,
    "Series_Complete_Moderna_12Plus": 15.9942,
    "Series_Complete_Pfizer_12Plus": 6.27011,
    "Series_Complete_Unk_Manuf_12Plus": 0.632878,
    "Series_Complete_Janssen_18Plus": -4.04329,
    "Series_Complete_Moderna_18Plus": -14.079,
    "Series_Complete_Pfizer_18Plus": -7.27635,
    "Series_Complete_Unk_Manuf_18Plus": 0.363388,
    "Series_Complete_Janssen_65Plus": 0.440104,
    "Series_Complete_Moderna_65Plus": -0.834406,
    "Series_Complete_Pfizer_65Plus": 0.790656,
    "Series_Complete_Unk_Manuf_65Plus": 0.320233,
    "Additional_Doses_18Plus_Vax_Pct": -3.33052,
    "Additional_Doses_50Plus_Vax_Pct": 5.58217,
    "Additional_Doses_65Plus_Vax_Pct": -0.332158,
    "Additional_Doses_Moderna": 1.88548,
    "Additional_Doses_Pfizer": 0.937175,
    "Additional_Doses_Janssen": -4.39878,
    "Additional_Doses_Unk_Manuf": 0.446367,
    "month": 0.491734,
    "year": 0.443981,
    "quarter": -0.00900019,
    "dayofyear": 7.49538,
    "dayofmonth": 0.0439242,
    "weekofyear": 10.1179,
    "Additional_Doses_Vax_Pct_1_w_lag": -0.102208,
    "Additional_Doses_Vax_Pct_3_m_lag": -0.0442407,
    "Additional_Doses_Vax_Pct_9_m_lag": 0.0214993,
    "rolling_mean": 0.153734,
    "rolling_std": 0.395855
}

# Calculate absolute values of the coefficients
abs_coefficients = {key: abs(value) for key, value in coefficients.items()}

# Calculate the 90th percentile
percentile_90 = np.percentile(list(abs_coefficients.values()), 90)

print(f'90th Percentile: {percentile_90}')

# Select predictors with coefficients >= 90th percentile
selected_predictors = {key: value for key, value in abs_coefficients.items() if value >= percentile_90}

# Output the selected predictors
print(selected_predictors)
90th Percentile: 10.225310000000002
{'MMWR_week': 17.7126, 'Distributed_Per_100k_12Plus': 15.8082, 'Distributed_Per_100k_18Plus': 11.192, 'Admin_Per_100k_5Plus': 13.0824, 'Recip_Administered': 13.6794, 'Series_Complete_Moderna_12Plus': 15.9942, 'Series_Complete_Moderna_18Plus': 14.079}

Given this feature selection, I will proceed by tuning my model as I did for the univariate Prophet model. One of the largest problems I faced when creating the multivariate Prophet model was this initial high test RMSE and overfitting. I am hoping that by setting the growth as logistic will help with the model predicting negative values and that the tuning overall will help with overfitting. Furthermore, I will set a floor and cap to assert that the output value should be between 0 and 1 as another potential solution.

Code
# Set for logistic growth
train['cap'] = 1  
test['cap'] = 1 

# Initialize Prophet model with logistic growth
initial_model = Prophet(growth='logistic')

# Add country holidays
initial_model.add_country_holidays(country_name='US')

# Add specified features as additional regressors
features = [
    'MMWR_week', 'Distributed_Per_100k_12Plus', 'Distributed_Per_100k_18Plus', 
    'Admin_Per_100k_5Plus', 'Recip_Administered', 'Series_Complete_Moderna_12Plus', 
    'Series_Complete_Moderna_18Plus', "Additional_Doses_Vax_Pct_1_w_lag", 
    "Additional_Doses_Vax_Pct_3_m_lag", "Additional_Doses_Vax_Pct_9_m_lag", 
    "rolling_mean", "rolling_std"
]
for feature in features:
    initial_model.add_regressor(feature)

# Fit the model to the training data
initial_model.fit(train)

# Additional settings for logistic growth
train['floor'] = 0
test['floor'] = 0

# Parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.001, 0.01, 0.1, 0.5],
    'seasonality_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'holidays_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'seasonality_mode': ['additive', 'multiplicative']
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each set of parameters 

# Cross-validation to evaluate all parameters
for params in all_params:
    m = Prophet(growth='logistic', **params)
    m.add_country_holidays(country_name='US')
    # Add each additional regressor
    for feature in features:
        m.add_regressor(feature)
    m.fit(train.assign(cap=1, floor=0))

    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params1 = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params1}")
17:15:00 - cmdstanpy - INFO - Chain [1] start processing
17:15:00 - cmdstanpy - INFO - Chain [1] done processing
17:15:00 - cmdstanpy - INFO - Chain [1] start processing
17:15:01 - cmdstanpy - INFO - Chain [1] done processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] done processing
17:15:02 - cmdstanpy - INFO - Chain [1] done processing
17:15:02 - cmdstanpy - INFO - Chain [1] done processing
17:15:03 - cmdstanpy - INFO - Chain [1] done processing
17:15:03 - cmdstanpy - INFO - Chain [1] start processing
17:15:04 - cmdstanpy - INFO - Chain [1] done processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] done processing
17:15:05 - cmdstanpy - INFO - Chain [1] done processing
17:15:05 - cmdstanpy - INFO - Chain [1] done processing
17:15:06 - cmdstanpy - INFO - Chain [1] done processing
17:15:06 - cmdstanpy - INFO - Chain [1] start processing
17:15:06 - cmdstanpy - INFO - Chain [1] done processing
17:15:07 - cmdstanpy - INFO - Chain [1] start processing
17:15:07 - cmdstanpy - INFO - Chain [1] start processing
17:15:07 - cmdstanpy - INFO - Chain [1] start processing
17:15:07 - cmdstanpy - INFO - Chain [1] start processing
17:15:07 - cmdstanpy - INFO - Chain [1] done processing
17:15:07 - cmdstanpy - INFO - Chain [1] done processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:08 - cmdstanpy - INFO - Chain [1] start processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] done processing
17:15:10 - cmdstanpy - INFO - Chain [1] done processing
17:15:11 - cmdstanpy - INFO - Chain [1] done processing
17:15:18 - cmdstanpy - INFO - Chain [1] done processing
17:15:18 - cmdstanpy - INFO - Chain [1] start processing
17:15:19 - cmdstanpy - INFO - Chain [1] done processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] done processing
17:15:20 - cmdstanpy - INFO - Chain [1] done processing
17:15:20 - cmdstanpy - INFO - Chain [1] done processing
17:15:23 - cmdstanpy - INFO - Chain [1] done processing
17:15:23 - cmdstanpy - INFO - Chain [1] start processing
17:15:26 - cmdstanpy - INFO - Chain [1] done processing
17:15:27 - cmdstanpy - INFO - Chain [1] start processing
17:15:27 - cmdstanpy - INFO - Chain [1] start processing
17:15:27 - cmdstanpy - INFO - Chain [1] start processing
17:15:27 - cmdstanpy - INFO - Chain [1] start processing
17:15:28 - cmdstanpy - INFO - Chain [1] done processing
17:15:30 - cmdstanpy - INFO - Chain [1] done processing
17:15:32 - cmdstanpy - INFO - Chain [1] done processing
17:15:41 - cmdstanpy - INFO - Chain [1] done processing
17:15:41 - cmdstanpy - INFO - Chain [1] start processing
17:15:42 - cmdstanpy - INFO - Chain [1] done processing
17:15:43 - cmdstanpy - INFO - Chain [1] start processing
17:15:43 - cmdstanpy - INFO - Chain [1] start processing
17:15:43 - cmdstanpy - INFO - Chain [1] start processing
17:15:43 - cmdstanpy - INFO - Chain [1] start processing
17:15:43 - cmdstanpy - INFO - Chain [1] done processing
17:15:43 - cmdstanpy - INFO - Chain [1] done processing
17:15:43 - cmdstanpy - INFO - Chain [1] done processing
17:15:44 - cmdstanpy - INFO - Chain [1] done processing
17:15:44 - cmdstanpy - INFO - Chain [1] start processing
17:15:46 - cmdstanpy - INFO - Chain [1] done processing
17:15:47 - cmdstanpy - INFO - Chain [1] start processing
17:15:47 - cmdstanpy - INFO - Chain [1] start processing
17:15:47 - cmdstanpy - INFO - Chain [1] start processing
17:15:47 - cmdstanpy - INFO - Chain [1] start processing
17:15:48 - cmdstanpy - INFO - Chain [1] done processing
17:15:48 - cmdstanpy - INFO - Chain [1] done processing
17:15:51 - cmdstanpy - INFO - Chain [1] done processing
17:16:02 - cmdstanpy - INFO - Chain [1] done processing
17:16:02 - cmdstanpy - INFO - Chain [1] start processing
17:16:03 - cmdstanpy - INFO - Chain [1] done processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] done processing
17:16:04 - cmdstanpy - INFO - Chain [1] done processing
17:16:04 - cmdstanpy - INFO - Chain [1] done processing
17:16:05 - cmdstanpy - INFO - Chain [1] done processing
17:16:05 - cmdstanpy - INFO - Chain [1] start processing
17:16:06 - cmdstanpy - INFO - Chain [1] done processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] done processing
17:16:07 - cmdstanpy - INFO - Chain [1] done processing
17:16:07 - cmdstanpy - INFO - Chain [1] done processing
17:16:08 - cmdstanpy - INFO - Chain [1] done processing
17:16:08 - cmdstanpy - INFO - Chain [1] start processing
17:16:08 - cmdstanpy - INFO - Chain [1] done processing
17:16:09 - cmdstanpy - INFO - Chain [1] start processing
17:16:09 - cmdstanpy - INFO - Chain [1] start processing
17:16:09 - cmdstanpy - INFO - Chain [1] start processing
17:16:09 - cmdstanpy - INFO - Chain [1] start processing
17:16:09 - cmdstanpy - INFO - Chain [1] done processing
17:16:09 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] start processing
17:16:10 - cmdstanpy - INFO - Chain [1] done processing
17:16:11 - cmdstanpy - INFO - Chain [1] start processing
17:16:11 - cmdstanpy - INFO - Chain [1] start processing
17:16:11 - cmdstanpy - INFO - Chain [1] start processing
17:16:11 - cmdstanpy - INFO - Chain [1] start processing
17:16:11 - cmdstanpy - INFO - Chain [1] done processing
17:16:12 - cmdstanpy - INFO - Chain [1] done processing
17:16:13 - cmdstanpy - INFO - Chain [1] done processing
17:16:20 - cmdstanpy - INFO - Chain [1] done processing
17:16:21 - cmdstanpy - INFO - Chain [1] start processing
17:16:21 - cmdstanpy - INFO - Chain [1] done processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] done processing
17:16:22 - cmdstanpy - INFO - Chain [1] done processing
17:16:23 - cmdstanpy - INFO - Chain [1] done processing
17:16:25 - cmdstanpy - INFO - Chain [1] done processing
17:16:26 - cmdstanpy - INFO - Chain [1] start processing
17:16:29 - cmdstanpy - INFO - Chain [1] done processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] done processing
17:16:33 - cmdstanpy - INFO - Chain [1] done processing
17:16:34 - cmdstanpy - INFO - Chain [1] done processing
17:16:44 - cmdstanpy - INFO - Chain [1] done processing
17:16:44 - cmdstanpy - INFO - Chain [1] start processing
17:16:45 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:49 - cmdstanpy - INFO - Chain [1] done processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:51 - cmdstanpy - INFO - Chain [1] done processing
17:16:51 - cmdstanpy - INFO - Chain [1] done processing
17:16:54 - cmdstanpy - INFO - Chain [1] done processing
17:17:05 - cmdstanpy - INFO - Chain [1] done processing
17:17:05 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] done processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:07 - cmdstanpy - INFO - Chain [1] done processing
17:17:07 - cmdstanpy - INFO - Chain [1] done processing
17:17:07 - cmdstanpy - INFO - Chain [1] done processing
17:17:08 - cmdstanpy - INFO - Chain [1] done processing
17:17:08 - cmdstanpy - INFO - Chain [1] start processing
17:17:08 - cmdstanpy - INFO - Chain [1] done processing
17:17:09 - cmdstanpy - INFO - Chain [1] start processing
17:17:09 - cmdstanpy - INFO - Chain [1] start processing
17:17:09 - cmdstanpy - INFO - Chain [1] start processing
17:17:09 - cmdstanpy - INFO - Chain [1] start processing
17:17:10 - cmdstanpy - INFO - Chain [1] done processing
17:17:10 - cmdstanpy - INFO - Chain [1] done processing
17:17:10 - cmdstanpy - INFO - Chain [1] done processing
17:17:11 - cmdstanpy - INFO - Chain [1] done processing
17:17:11 - cmdstanpy - INFO - Chain [1] start processing
17:17:11 - cmdstanpy - INFO - Chain [1] done processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] done processing
17:17:12 - cmdstanpy - INFO - Chain [1] done processing
17:17:12 - cmdstanpy - INFO - Chain [1] done processing
17:17:13 - cmdstanpy - INFO - Chain [1] done processing
17:17:13 - cmdstanpy - INFO - Chain [1] start processing
17:17:13 - cmdstanpy - INFO - Chain [1] done processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:14 - cmdstanpy - INFO - Chain [1] done processing
17:17:14 - cmdstanpy - INFO - Chain [1] done processing
17:17:16 - cmdstanpy - INFO - Chain [1] done processing
17:17:23 - cmdstanpy - INFO - Chain [1] done processing
17:17:23 - cmdstanpy - INFO - Chain [1] start processing
17:17:23 - cmdstanpy - INFO - Chain [1] done processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:25 - cmdstanpy - INFO - Chain [1] done processing
17:17:25 - cmdstanpy - INFO - Chain [1] done processing
17:17:25 - cmdstanpy - INFO - Chain [1] done processing
17:17:28 - cmdstanpy - INFO - Chain [1] done processing
17:17:28 - cmdstanpy - INFO - Chain [1] start processing
17:17:31 - cmdstanpy - INFO - Chain [1] done processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] done processing
17:17:35 - cmdstanpy - INFO - Chain [1] done processing
17:17:37 - cmdstanpy - INFO - Chain [1] done processing
17:17:46 - cmdstanpy - INFO - Chain [1] done processing
17:17:46 - cmdstanpy - INFO - Chain [1] start processing
17:17:47 - cmdstanpy - INFO - Chain [1] done processing
17:17:48 - cmdstanpy - INFO - Chain [1] start processing
17:17:48 - cmdstanpy - INFO - Chain [1] start processing
17:17:48 - cmdstanpy - INFO - Chain [1] start processing
17:17:48 - cmdstanpy - INFO - Chain [1] start processing
17:17:48 - cmdstanpy - INFO - Chain [1] done processing
17:17:48 - cmdstanpy - INFO - Chain [1] done processing
17:17:48 - cmdstanpy - INFO - Chain [1] done processing
17:17:49 - cmdstanpy - INFO - Chain [1] done processing
17:17:49 - cmdstanpy - INFO - Chain [1] start processing
17:17:51 - cmdstanpy - INFO - Chain [1] done processing
17:17:52 - cmdstanpy - INFO - Chain [1] start processing
17:17:52 - cmdstanpy - INFO - Chain [1] start processing
17:17:52 - cmdstanpy - INFO - Chain [1] start processing
17:17:52 - cmdstanpy - INFO - Chain [1] start processing
17:17:53 - cmdstanpy - INFO - Chain [1] done processing
17:17:53 - cmdstanpy - INFO - Chain [1] done processing
17:17:56 - cmdstanpy - INFO - Chain [1] done processing
17:18:07 - cmdstanpy - INFO - Chain [1] done processing
17:18:07 - cmdstanpy - INFO - Chain [1] start processing
17:18:08 - cmdstanpy - INFO - Chain [1] done processing
17:18:09 - cmdstanpy - INFO - Chain [1] start processing
17:18:09 - cmdstanpy - INFO - Chain [1] start processing
17:18:09 - cmdstanpy - INFO - Chain [1] start processing
17:18:09 - cmdstanpy - INFO - Chain [1] start processing
17:18:09 - cmdstanpy - INFO - Chain [1] done processing
17:18:09 - cmdstanpy - INFO - Chain [1] done processing
17:18:09 - cmdstanpy - INFO - Chain [1] done processing
17:18:10 - cmdstanpy - INFO - Chain [1] done processing
17:18:10 - cmdstanpy - INFO - Chain [1] start processing
17:18:11 - cmdstanpy - INFO - Chain [1] done processing
17:18:12 - cmdstanpy - INFO - Chain [1] start processing
17:18:12 - cmdstanpy - INFO - Chain [1] start processing
17:18:12 - cmdstanpy - INFO - Chain [1] start processing
17:18:12 - cmdstanpy - INFO - Chain [1] start processing
17:18:12 - cmdstanpy - INFO - Chain [1] done processing
17:18:12 - cmdstanpy - INFO - Chain [1] done processing
17:18:12 - cmdstanpy - INFO - Chain [1] done processing
17:18:13 - cmdstanpy - INFO - Chain [1] done processing
17:18:13 - cmdstanpy - INFO - Chain [1] start processing
17:18:13 - cmdstanpy - INFO - Chain [1] done processing
17:18:14 - cmdstanpy - INFO - Chain [1] start processing
17:18:14 - cmdstanpy - INFO - Chain [1] start processing
17:18:14 - cmdstanpy - INFO - Chain [1] start processing
17:18:14 - cmdstanpy - INFO - Chain [1] start processing
17:18:14 - cmdstanpy - INFO - Chain [1] done processing
17:18:14 - cmdstanpy - INFO - Chain [1] done processing
17:18:15 - cmdstanpy - INFO - Chain [1] done processing
17:18:15 - cmdstanpy - INFO - Chain [1] done processing
17:18:15 - cmdstanpy - INFO - Chain [1] start processing
17:18:15 - cmdstanpy - INFO - Chain [1] done processing
17:18:16 - cmdstanpy - INFO - Chain [1] start processing
17:18:16 - cmdstanpy - INFO - Chain [1] start processing
17:18:16 - cmdstanpy - INFO - Chain [1] start processing
17:18:16 - cmdstanpy - INFO - Chain [1] start processing
17:18:16 - cmdstanpy - INFO - Chain [1] done processing
17:18:17 - cmdstanpy - INFO - Chain [1] done processing
17:18:18 - cmdstanpy - INFO - Chain [1] done processing
17:18:25 - cmdstanpy - INFO - Chain [1] done processing
17:18:25 - cmdstanpy - INFO - Chain [1] start processing
17:18:26 - cmdstanpy - INFO - Chain [1] done processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] done processing
17:18:27 - cmdstanpy - INFO - Chain [1] done processing
17:18:27 - cmdstanpy - INFO - Chain [1] done processing
17:18:30 - cmdstanpy - INFO - Chain [1] done processing
17:18:30 - cmdstanpy - INFO - Chain [1] start processing
17:18:33 - cmdstanpy - INFO - Chain [1] done processing
17:18:34 - cmdstanpy - INFO - Chain [1] start processing
17:18:34 - cmdstanpy - INFO - Chain [1] start processing
17:18:34 - cmdstanpy - INFO - Chain [1] start processing
17:18:34 - cmdstanpy - INFO - Chain [1] start processing
17:18:35 - cmdstanpy - INFO - Chain [1] done processing
17:18:37 - cmdstanpy - INFO - Chain [1] done processing
17:18:39 - cmdstanpy - INFO - Chain [1] done processing
17:18:48 - cmdstanpy - INFO - Chain [1] done processing
17:18:48 - cmdstanpy - INFO - Chain [1] start processing
17:18:49 - cmdstanpy - INFO - Chain [1] done processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] done processing
17:18:50 - cmdstanpy - INFO - Chain [1] done processing
17:18:50 - cmdstanpy - INFO - Chain [1] done processing
17:18:51 - cmdstanpy - INFO - Chain [1] done processing
17:18:51 - cmdstanpy - INFO - Chain [1] start processing
17:18:53 - cmdstanpy - INFO - Chain [1] done processing
17:18:54 - cmdstanpy - INFO - Chain [1] start processing
17:18:54 - cmdstanpy - INFO - Chain [1] start processing
17:18:54 - cmdstanpy - INFO - Chain [1] start processing
17:18:54 - cmdstanpy - INFO - Chain [1] start processing
17:18:55 - cmdstanpy - INFO - Chain [1] done processing
17:18:55 - cmdstanpy - INFO - Chain [1] done processing
17:18:58 - cmdstanpy - INFO - Chain [1] done processing
17:19:09 - cmdstanpy - INFO - Chain [1] done processing
17:19:10 - cmdstanpy - INFO - Chain [1] start processing
17:19:10 - cmdstanpy - INFO - Chain [1] done processing
17:19:11 - cmdstanpy - INFO - Chain [1] start processing
17:19:11 - cmdstanpy - INFO - Chain [1] start processing
17:19:11 - cmdstanpy - INFO - Chain [1] start processing
17:19:11 - cmdstanpy - INFO - Chain [1] start processing
17:19:11 - cmdstanpy - INFO - Chain [1] done processing
17:19:11 - cmdstanpy - INFO - Chain [1] done processing
17:19:11 - cmdstanpy - INFO - Chain [1] done processing
17:19:11 - cmdstanpy - INFO - Chain [1] done processing
17:19:11 - cmdstanpy - INFO - Chain [1] start processing
17:19:11 - cmdstanpy - INFO - Chain [1] done processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] done processing
17:19:12 - cmdstanpy - INFO - Chain [1] done processing
17:19:12 - cmdstanpy - INFO - Chain [1] done processing
17:19:12 - cmdstanpy - INFO - Chain [1] done processing
17:19:13 - cmdstanpy - INFO - Chain [1] start processing
17:19:14 - cmdstanpy - INFO - Chain [1] done processing
17:19:15 - cmdstanpy - INFO - Chain [1] start processing
17:19:15 - cmdstanpy - INFO - Chain [1] start processing
17:19:15 - cmdstanpy - INFO - Chain [1] start processing
17:19:15 - cmdstanpy - INFO - Chain [1] start processing
17:19:15 - cmdstanpy - INFO - Chain [1] done processing
17:19:15 - cmdstanpy - INFO - Chain [1] done processing
17:19:15 - cmdstanpy - INFO - Chain [1] done processing
17:19:16 - cmdstanpy - INFO - Chain [1] done processing
17:19:16 - cmdstanpy - INFO - Chain [1] start processing
17:19:16 - cmdstanpy - INFO - Chain [1] done processing
17:19:17 - cmdstanpy - INFO - Chain [1] start processing
17:19:17 - cmdstanpy - INFO - Chain [1] start processing
17:19:17 - cmdstanpy - INFO - Chain [1] start processing
17:19:17 - cmdstanpy - INFO - Chain [1] start processing
17:19:17 - cmdstanpy - INFO - Chain [1] done processing
17:19:17 - cmdstanpy - INFO - Chain [1] done processing
17:19:17 - cmdstanpy - INFO - Chain [1] done processing
17:19:18 - cmdstanpy - INFO - Chain [1] done processing
17:19:18 - cmdstanpy - INFO - Chain [1] start processing
17:19:18 - cmdstanpy - INFO - Chain [1] done processing
17:19:19 - cmdstanpy - INFO - Chain [1] start processing
17:19:19 - cmdstanpy - INFO - Chain [1] done processing
17:19:19 - cmdstanpy - INFO - Chain [1] start processing
17:19:19 - cmdstanpy - INFO - Chain [1] start processing
17:19:19 - cmdstanpy - INFO - Chain [1] start processing
17:19:19 - cmdstanpy - INFO - Chain [1] done processing
17:19:19 - cmdstanpy - INFO - Chain [1] done processing
17:19:27 - cmdstanpy - INFO - Chain [1] done processing
17:19:27 - cmdstanpy - INFO - Chain [1] start processing
17:19:28 - cmdstanpy - INFO - Chain [1] done processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] done processing
17:19:29 - cmdstanpy - INFO - Chain [1] done processing
17:19:30 - cmdstanpy - INFO - Chain [1] done processing
17:19:31 - cmdstanpy - INFO - Chain [1] done processing
17:19:31 - cmdstanpy - INFO - Chain [1] start processing
17:19:31 - cmdstanpy - INFO - Chain [1] done processing
17:19:32 - cmdstanpy - INFO - Chain [1] start processing
17:19:32 - cmdstanpy - INFO - Chain [1] start processing
17:19:32 - cmdstanpy - INFO - Chain [1] start processing
17:19:32 - cmdstanpy - INFO - Chain [1] done processing
17:19:32 - cmdstanpy - INFO - Chain [1] start processing
17:19:32 - cmdstanpy - INFO - Chain [1] done processing
17:19:33 - cmdstanpy - INFO - Chain [1] done processing
17:19:33 - cmdstanpy - INFO - Chain [1] done processing
17:19:33 - cmdstanpy - INFO - Chain [1] start processing
17:19:34 - cmdstanpy - INFO - Chain [1] done processing
17:19:35 - cmdstanpy - INFO - Chain [1] start processing
17:19:35 - cmdstanpy - INFO - Chain [1] start processing
17:19:35 - cmdstanpy - INFO - Chain [1] start processing
17:19:35 - cmdstanpy - INFO - Chain [1] start processing
17:19:35 - cmdstanpy - INFO - Chain [1] done processing
17:19:35 - cmdstanpy - INFO - Chain [1] done processing
17:19:36 - cmdstanpy - INFO - Chain [1] done processing
17:19:36 - cmdstanpy - INFO - Chain [1] done processing
17:19:36 - cmdstanpy - INFO - Chain [1] start processing
17:19:36 - cmdstanpy - INFO - Chain [1] done processing
17:19:37 - cmdstanpy - INFO - Chain [1] start processing
17:19:37 - cmdstanpy - INFO - Chain [1] start processing
17:19:37 - cmdstanpy - INFO - Chain [1] start processing
17:19:37 - cmdstanpy - INFO - Chain [1] done processing
17:19:37 - cmdstanpy - INFO - Chain [1] start processing
17:19:37 - cmdstanpy - INFO - Chain [1] done processing
17:19:37 - cmdstanpy - INFO - Chain [1] done processing
17:19:37 - cmdstanpy - INFO - Chain [1] done processing
17:19:38 - cmdstanpy - INFO - Chain [1] start processing
17:19:38 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:40 - cmdstanpy - INFO - Chain [1] done processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] done processing
17:19:41 - cmdstanpy - INFO - Chain [1] done processing
17:19:41 - cmdstanpy - INFO - Chain [1] done processing
17:19:42 - cmdstanpy - INFO - Chain [1] done processing
17:19:42 - cmdstanpy - INFO - Chain [1] start processing
17:19:42 - cmdstanpy - INFO - Chain [1] done processing
17:19:43 - cmdstanpy - INFO - Chain [1] start processing
17:19:43 - cmdstanpy - INFO - Chain [1] start processing
17:19:43 - cmdstanpy - INFO - Chain [1] start processing
17:19:43 - cmdstanpy - INFO - Chain [1] start processing
17:19:43 - cmdstanpy - INFO - Chain [1] done processing
17:19:43 - cmdstanpy - INFO - Chain [1] done processing
17:19:44 - cmdstanpy - INFO - Chain [1] done processing
17:19:44 - cmdstanpy - INFO - Chain [1] done processing
17:19:44 - cmdstanpy - INFO - Chain [1] start processing
17:19:44 - cmdstanpy - INFO - Chain [1] done processing
17:19:45 - cmdstanpy - INFO - Chain [1] start processing
17:19:45 - cmdstanpy - INFO - Chain [1] start processing
17:19:45 - cmdstanpy - INFO - Chain [1] done processing
17:19:45 - cmdstanpy - INFO - Chain [1] start processing
17:19:45 - cmdstanpy - INFO - Chain [1] start processing
17:19:46 - cmdstanpy - INFO - Chain [1] done processing
17:19:46 - cmdstanpy - INFO - Chain [1] done processing
17:19:53 - cmdstanpy - INFO - Chain [1] done processing
17:19:53 - cmdstanpy - INFO - Chain [1] start processing
17:19:54 - cmdstanpy - INFO - Chain [1] done processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] done processing
17:19:55 - cmdstanpy - INFO - Chain [1] done processing
17:19:56 - cmdstanpy - INFO - Chain [1] done processing
17:19:57 - cmdstanpy - INFO - Chain [1] done processing
17:19:57 - cmdstanpy - INFO - Chain [1] start processing
17:19:57 - cmdstanpy - INFO - Chain [1] done processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] done processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] done processing
17:19:58 - cmdstanpy - INFO - Chain [1] done processing
17:19:59 - cmdstanpy - INFO - Chain [1] done processing
17:19:59 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] done processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:01 - cmdstanpy - INFO - Chain [1] done processing
17:20:01 - cmdstanpy - INFO - Chain [1] done processing
17:20:01 - cmdstanpy - INFO - Chain [1] done processing
17:20:02 - cmdstanpy - INFO - Chain [1] done processing
17:20:02 - cmdstanpy - INFO - Chain [1] start processing
17:20:02 - cmdstanpy - INFO - Chain [1] done processing
17:20:03 - cmdstanpy - INFO - Chain [1] start processing
17:20:03 - cmdstanpy - INFO - Chain [1] done processing
17:20:03 - cmdstanpy - INFO - Chain [1] start processing
17:20:03 - cmdstanpy - INFO - Chain [1] start processing
17:20:03 - cmdstanpy - INFO - Chain [1] start processing
17:20:03 - cmdstanpy - INFO - Chain [1] done processing
17:20:03 - cmdstanpy - INFO - Chain [1] done processing
17:20:03 - cmdstanpy - INFO - Chain [1] done processing
17:20:03 - cmdstanpy - INFO - Chain [1] start processing
17:20:03 - cmdstanpy - INFO - Chain [1] done processing
17:20:04 - cmdstanpy - INFO - Chain [1] start processing
17:20:04 - cmdstanpy - INFO - Chain [1] done processing
17:20:04 - cmdstanpy - INFO - Chain [1] start processing
17:20:04 - cmdstanpy - INFO - Chain [1] start processing
17:20:04 - cmdstanpy - INFO - Chain [1] start processing
17:20:04 - cmdstanpy - INFO - Chain [1] done processing
17:20:05 - cmdstanpy - INFO - Chain [1] done processing
17:20:05 - cmdstanpy - INFO - Chain [1] done processing
17:20:05 - cmdstanpy - INFO - Chain [1] start processing
17:20:06 - cmdstanpy - INFO - Chain [1] done processing
17:20:07 - cmdstanpy - INFO - Chain [1] start processing
17:20:07 - cmdstanpy - INFO - Chain [1] start processing
17:20:07 - cmdstanpy - INFO - Chain [1] done processing
17:20:07 - cmdstanpy - INFO - Chain [1] start processing
17:20:07 - cmdstanpy - INFO - Chain [1] start processing
17:20:07 - cmdstanpy - INFO - Chain [1] done processing
17:20:07 - cmdstanpy - INFO - Chain [1] done processing
17:20:08 - cmdstanpy - INFO - Chain [1] done processing
17:20:08 - cmdstanpy - INFO - Chain [1] start processing
17:20:08 - cmdstanpy - INFO - Chain [1] done processing
17:20:09 - cmdstanpy - INFO - Chain [1] start processing
17:20:09 - cmdstanpy - INFO - Chain [1] start processing
17:20:09 - cmdstanpy - INFO - Chain [1] start processing
17:20:09 - cmdstanpy - INFO - Chain [1] start processing
17:20:09 - cmdstanpy - INFO - Chain [1] done processing
17:20:09 - cmdstanpy - INFO - Chain [1] done processing
17:20:09 - cmdstanpy - INFO - Chain [1] done processing
17:20:10 - cmdstanpy - INFO - Chain [1] done processing
17:20:10 - cmdstanpy - INFO - Chain [1] start processing
17:20:10 - cmdstanpy - INFO - Chain [1] done processing
17:20:11 - cmdstanpy - INFO - Chain [1] start processing
17:20:11 - cmdstanpy - INFO - Chain [1] done processing
17:20:11 - cmdstanpy - INFO - Chain [1] start processing
17:20:11 - cmdstanpy - INFO - Chain [1] start processing
17:20:11 - cmdstanpy - INFO - Chain [1] start processing
17:20:11 - cmdstanpy - INFO - Chain [1] done processing
17:20:11 - cmdstanpy - INFO - Chain [1] done processing
17:20:19 - cmdstanpy - INFO - Chain [1] done processing
17:20:19 - cmdstanpy - INFO - Chain [1] start processing
17:20:20 - cmdstanpy - INFO - Chain [1] done processing
17:20:20 - cmdstanpy - INFO - Chain [1] start processing
17:20:20 - cmdstanpy - INFO - Chain [1] start processing
17:20:21 - cmdstanpy - INFO - Chain [1] start processing
17:20:21 - cmdstanpy - INFO - Chain [1] start processing
17:20:21 - cmdstanpy - INFO - Chain [1] done processing
17:20:21 - cmdstanpy - INFO - Chain [1] done processing
17:20:21 - cmdstanpy - INFO - Chain [1] done processing
17:20:22 - cmdstanpy - INFO - Chain [1] done processing
17:20:22 - cmdstanpy - INFO - Chain [1] start processing
17:20:23 - cmdstanpy - INFO - Chain [1] done processing
17:20:24 - cmdstanpy - INFO - Chain [1] start processing
17:20:24 - cmdstanpy - INFO - Chain [1] start processing
17:20:24 - cmdstanpy - INFO - Chain [1] start processing
17:20:24 - cmdstanpy - INFO - Chain [1] start processing
17:20:24 - cmdstanpy - INFO - Chain [1] done processing
17:20:24 - cmdstanpy - INFO - Chain [1] done processing
17:20:24 - cmdstanpy - INFO - Chain [1] done processing
17:20:24 - cmdstanpy - INFO - Chain [1] done processing
17:20:25 - cmdstanpy - INFO - Chain [1] start processing
17:20:25 - cmdstanpy - INFO - Chain [1] done processing
17:20:26 - cmdstanpy - INFO - Chain [1] start processing
17:20:26 - cmdstanpy - INFO - Chain [1] start processing
17:20:26 - cmdstanpy - INFO - Chain [1] start processing
17:20:26 - cmdstanpy - INFO - Chain [1] start processing
17:20:26 - cmdstanpy - INFO - Chain [1] done processing
17:20:27 - cmdstanpy - INFO - Chain [1] done processing
17:20:27 - cmdstanpy - INFO - Chain [1] done processing
17:20:27 - cmdstanpy - INFO - Chain [1] done processing
17:20:28 - cmdstanpy - INFO - Chain [1] start processing
17:20:28 - cmdstanpy - INFO - Chain [1] done processing
17:20:29 - cmdstanpy - INFO - Chain [1] start processing
17:20:29 - cmdstanpy - INFO - Chain [1] start processing
17:20:29 - cmdstanpy - INFO - Chain [1] start processing
17:20:29 - cmdstanpy - INFO - Chain [1] start processing
17:20:29 - cmdstanpy - INFO - Chain [1] done processing
17:20:29 - cmdstanpy - INFO - Chain [1] done processing
17:20:29 - cmdstanpy - INFO - Chain [1] done processing
17:20:29 - cmdstanpy - INFO - Chain [1] done processing
17:20:29 - cmdstanpy - INFO - Chain [1] start processing
17:20:29 - cmdstanpy - INFO - Chain [1] done processing
17:20:30 - cmdstanpy - INFO - Chain [1] start processing
17:20:30 - cmdstanpy - INFO - Chain [1] start processing
17:20:30 - cmdstanpy - INFO - Chain [1] start processing
17:20:30 - cmdstanpy - INFO - Chain [1] start processing
17:20:30 - cmdstanpy - INFO - Chain [1] done processing
17:20:30 - cmdstanpy - INFO - Chain [1] done processing
17:20:30 - cmdstanpy - INFO - Chain [1] done processing
17:20:30 - cmdstanpy - INFO - Chain [1] done processing
17:20:30 - cmdstanpy - INFO - Chain [1] start processing
17:20:32 - cmdstanpy - INFO - Chain [1] done processing
17:20:32 - cmdstanpy - INFO - Chain [1] start processing
17:20:32 - cmdstanpy - INFO - Chain [1] start processing
17:20:32 - cmdstanpy - INFO - Chain [1] done processing
17:20:33 - cmdstanpy - INFO - Chain [1] start processing
17:20:33 - cmdstanpy - INFO - Chain [1] start processing
17:20:33 - cmdstanpy - INFO - Chain [1] done processing
17:20:33 - cmdstanpy - INFO - Chain [1] done processing
17:20:34 - cmdstanpy - INFO - Chain [1] done processing
17:20:34 - cmdstanpy - INFO - Chain [1] start processing
17:20:34 - cmdstanpy - INFO - Chain [1] done processing
17:20:35 - cmdstanpy - INFO - Chain [1] start processing
17:20:35 - cmdstanpy - INFO - Chain [1] start processing
17:20:35 - cmdstanpy - INFO - Chain [1] start processing
17:20:35 - cmdstanpy - INFO - Chain [1] start processing
17:20:35 - cmdstanpy - INFO - Chain [1] done processing
17:20:35 - cmdstanpy - INFO - Chain [1] done processing
17:20:35 - cmdstanpy - INFO - Chain [1] done processing
17:20:35 - cmdstanpy - INFO - Chain [1] done processing
17:20:36 - cmdstanpy - INFO - Chain [1] start processing
17:20:36 - cmdstanpy - INFO - Chain [1] done processing
17:20:37 - cmdstanpy - INFO - Chain [1] start processing
17:20:37 - cmdstanpy - INFO - Chain [1] done processing
17:20:37 - cmdstanpy - INFO - Chain [1] start processing
17:20:37 - cmdstanpy - INFO - Chain [1] start processing
17:20:37 - cmdstanpy - INFO - Chain [1] start processing
17:20:37 - cmdstanpy - INFO - Chain [1] done processing
17:20:37 - cmdstanpy - INFO - Chain [1] done processing
17:20:45 - cmdstanpy - INFO - Chain [1] done processing
17:20:45 - cmdstanpy - INFO - Chain [1] start processing
17:20:46 - cmdstanpy - INFO - Chain [1] done processing
17:20:46 - cmdstanpy - INFO - Chain [1] start processing
17:20:47 - cmdstanpy - INFO - Chain [1] start processing
17:20:47 - cmdstanpy - INFO - Chain [1] start processing
17:20:47 - cmdstanpy - INFO - Chain [1] start processing
17:20:47 - cmdstanpy - INFO - Chain [1] done processing
17:20:47 - cmdstanpy - INFO - Chain [1] done processing
17:20:48 - cmdstanpy - INFO - Chain [1] done processing
17:20:48 - cmdstanpy - INFO - Chain [1] done processing
17:20:48 - cmdstanpy - INFO - Chain [1] start processing
17:20:49 - cmdstanpy - INFO - Chain [1] done processing
17:20:50 - cmdstanpy - INFO - Chain [1] start processing
17:20:50 - cmdstanpy - INFO - Chain [1] start processing
17:20:50 - cmdstanpy - INFO - Chain [1] start processing
17:20:50 - cmdstanpy - INFO - Chain [1] start processing
17:20:50 - cmdstanpy - INFO - Chain [1] done processing
17:20:50 - cmdstanpy - INFO - Chain [1] done processing
17:20:50 - cmdstanpy - INFO - Chain [1] done processing
17:20:50 - cmdstanpy - INFO - Chain [1] done processing
17:20:51 - cmdstanpy - INFO - Chain [1] start processing
17:20:51 - cmdstanpy - INFO - Chain [1] done processing
17:20:52 - cmdstanpy - INFO - Chain [1] start processing
17:20:52 - cmdstanpy - INFO - Chain [1] start processing
17:20:52 - cmdstanpy - INFO - Chain [1] start processing
17:20:52 - cmdstanpy - INFO - Chain [1] start processing
17:20:52 - cmdstanpy - INFO - Chain [1] done processing
17:20:53 - cmdstanpy - INFO - Chain [1] done processing
17:20:53 - cmdstanpy - INFO - Chain [1] done processing
17:20:53 - cmdstanpy - INFO - Chain [1] done processing
17:20:54 - cmdstanpy - INFO - Chain [1] start processing
17:20:54 - cmdstanpy - INFO - Chain [1] done processing
17:20:55 - cmdstanpy - INFO - Chain [1] start processing
17:20:55 - cmdstanpy - INFO - Chain [1] start processing
17:20:55 - cmdstanpy - INFO - Chain [1] start processing
17:20:55 - cmdstanpy - INFO - Chain [1] start processing
17:20:55 - cmdstanpy - INFO - Chain [1] done processing
17:20:55 - cmdstanpy - INFO - Chain [1] done processing
17:20:55 - cmdstanpy - INFO - Chain [1] done processing
17:20:55 - cmdstanpy - INFO - Chain [1] done processing
17:20:55 - cmdstanpy - INFO - Chain [1] start processing
17:20:56 - cmdstanpy - INFO - Chain [1] done processing
17:20:56 - cmdstanpy - INFO - Chain [1] start processing
17:20:56 - cmdstanpy - INFO - Chain [1] start processing
17:20:57 - cmdstanpy - INFO - Chain [1] start processing
17:20:57 - cmdstanpy - INFO - Chain [1] start processing
17:20:57 - cmdstanpy - INFO - Chain [1] done processing
17:20:57 - cmdstanpy - INFO - Chain [1] done processing
17:20:57 - cmdstanpy - INFO - Chain [1] done processing
17:20:57 - cmdstanpy - INFO - Chain [1] done processing
17:20:57 - cmdstanpy - INFO - Chain [1] start processing
17:20:58 - cmdstanpy - INFO - Chain [1] done processing
17:20:59 - cmdstanpy - INFO - Chain [1] start processing
17:20:59 - cmdstanpy - INFO - Chain [1] start processing
17:20:59 - cmdstanpy - INFO - Chain [1] start processing
17:20:59 - cmdstanpy - INFO - Chain [1] start processing
17:20:59 - cmdstanpy - INFO - Chain [1] done processing
17:20:59 - cmdstanpy - INFO - Chain [1] done processing
17:20:59 - cmdstanpy - INFO - Chain [1] done processing
17:21:00 - cmdstanpy - INFO - Chain [1] done processing
17:21:00 - cmdstanpy - INFO - Chain [1] start processing
17:21:00 - cmdstanpy - INFO - Chain [1] done processing
17:21:01 - cmdstanpy - INFO - Chain [1] start processing
17:21:01 - cmdstanpy - INFO - Chain [1] start processing
17:21:01 - cmdstanpy - INFO - Chain [1] start processing
17:21:01 - cmdstanpy - INFO - Chain [1] start processing
17:21:01 - cmdstanpy - INFO - Chain [1] done processing
17:21:01 - cmdstanpy - INFO - Chain [1] done processing
17:21:01 - cmdstanpy - INFO - Chain [1] done processing
17:21:02 - cmdstanpy - INFO - Chain [1] done processing
17:21:02 - cmdstanpy - INFO - Chain [1] start processing
17:21:02 - cmdstanpy - INFO - Chain [1] done processing
17:21:03 - cmdstanpy - INFO - Chain [1] start processing
17:21:03 - cmdstanpy - INFO - Chain [1] start processing
17:21:03 - cmdstanpy - INFO - Chain [1] done processing
17:21:03 - cmdstanpy - INFO - Chain [1] start processing
17:21:03 - cmdstanpy - INFO - Chain [1] start processing
17:21:04 - cmdstanpy - INFO - Chain [1] done processing
17:21:04 - cmdstanpy - INFO - Chain [1] done processing
17:21:05 - cmdstanpy - INFO - Chain [1] done processing
17:21:05 - cmdstanpy - INFO - Chain [1] start processing
17:21:05 - cmdstanpy - INFO - Chain [1] done processing
17:21:06 - cmdstanpy - INFO - Chain [1] start processing
17:21:06 - cmdstanpy - INFO - Chain [1] start processing
17:21:06 - cmdstanpy - INFO - Chain [1] start processing
17:21:06 - cmdstanpy - INFO - Chain [1] start processing
17:21:07 - cmdstanpy - INFO - Chain [1] done processing
17:21:07 - cmdstanpy - INFO - Chain [1] done processing
17:21:07 - cmdstanpy - INFO - Chain [1] done processing
17:21:07 - cmdstanpy - INFO - Chain [1] done processing
17:21:07 - cmdstanpy - INFO - Chain [1] start processing
17:21:08 - cmdstanpy - INFO - Chain [1] done processing
17:21:09 - cmdstanpy - INFO - Chain [1] start processing
17:21:09 - cmdstanpy - INFO - Chain [1] start processing
17:21:09 - cmdstanpy - INFO - Chain [1] start processing
17:21:09 - cmdstanpy - INFO - Chain [1] start processing
17:21:09 - cmdstanpy - INFO - Chain [1] done processing
17:21:09 - cmdstanpy - INFO - Chain [1] done processing
17:21:10 - cmdstanpy - INFO - Chain [1] done processing
17:21:10 - cmdstanpy - INFO - Chain [1] done processing
17:21:10 - cmdstanpy - INFO - Chain [1] start processing
17:21:11 - cmdstanpy - INFO - Chain [1] done processing
17:21:12 - cmdstanpy - INFO - Chain [1] start processing
17:21:12 - cmdstanpy - INFO - Chain [1] start processing
17:21:12 - cmdstanpy - INFO - Chain [1] start processing
17:21:12 - cmdstanpy - INFO - Chain [1] start processing
17:21:13 - cmdstanpy - INFO - Chain [1] done processing
17:21:13 - cmdstanpy - INFO - Chain [1] done processing
17:21:13 - cmdstanpy - INFO - Chain [1] done processing
17:21:13 - cmdstanpy - INFO - Chain [1] done processing
17:21:13 - cmdstanpy - INFO - Chain [1] start processing
17:21:13 - cmdstanpy - INFO - Chain [1] done processing
17:21:14 - cmdstanpy - INFO - Chain [1] start processing
17:21:14 - cmdstanpy - INFO - Chain [1] start processing
17:21:14 - cmdstanpy - INFO - Chain [1] start processing
17:21:14 - cmdstanpy - INFO - Chain [1] start processing
17:21:14 - cmdstanpy - INFO - Chain [1] done processing
17:21:14 - cmdstanpy - INFO - Chain [1] done processing
17:21:15 - cmdstanpy - INFO - Chain [1] done processing
17:21:15 - cmdstanpy - INFO - Chain [1] done processing
17:21:15 - cmdstanpy - INFO - Chain [1] start processing
17:21:15 - cmdstanpy - INFO - Chain [1] done processing
17:21:16 - cmdstanpy - INFO - Chain [1] start processing
17:21:16 - cmdstanpy - INFO - Chain [1] start processing
17:21:16 - cmdstanpy - INFO - Chain [1] start processing
17:21:16 - cmdstanpy - INFO - Chain [1] start processing
17:21:16 - cmdstanpy - INFO - Chain [1] done processing
17:21:16 - cmdstanpy - INFO - Chain [1] done processing
17:21:16 - cmdstanpy - INFO - Chain [1] done processing
17:21:16 - cmdstanpy - INFO - Chain [1] done processing
17:21:16 - cmdstanpy - INFO - Chain [1] start processing
17:21:17 - cmdstanpy - INFO - Chain [1] done processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:19 - cmdstanpy - INFO - Chain [1] done processing
17:21:19 - cmdstanpy - INFO - Chain [1] done processing
17:21:19 - cmdstanpy - INFO - Chain [1] done processing
17:21:19 - cmdstanpy - INFO - Chain [1] done processing
17:21:19 - cmdstanpy - INFO - Chain [1] start processing
17:21:19 - cmdstanpy - INFO - Chain [1] done processing
17:21:20 - cmdstanpy - INFO - Chain [1] start processing
17:21:20 - cmdstanpy - INFO - Chain [1] start processing
17:21:20 - cmdstanpy - INFO - Chain [1] start processing
17:21:20 - cmdstanpy - INFO - Chain [1] start processing
17:21:21 - cmdstanpy - INFO - Chain [1] done processing
17:21:21 - cmdstanpy - INFO - Chain [1] done processing
17:21:21 - cmdstanpy - INFO - Chain [1] done processing
17:21:21 - cmdstanpy - INFO - Chain [1] done processing
17:21:21 - cmdstanpy - INFO - Chain [1] start processing
17:21:22 - cmdstanpy - INFO - Chain [1] done processing
17:21:23 - cmdstanpy - INFO - Chain [1] start processing
17:21:23 - cmdstanpy - INFO - Chain [1] start processing
17:21:23 - cmdstanpy - INFO - Chain [1] start processing
17:21:23 - cmdstanpy - INFO - Chain [1] start processing
17:21:23 - cmdstanpy - INFO - Chain [1] done processing
17:21:23 - cmdstanpy - INFO - Chain [1] done processing
17:21:23 - cmdstanpy - INFO - Chain [1] done processing
17:21:24 - cmdstanpy - INFO - Chain [1] done processing
17:21:24 - cmdstanpy - INFO - Chain [1] start processing
17:21:25 - cmdstanpy - INFO - Chain [1] done processing
17:21:26 - cmdstanpy - INFO - Chain [1] start processing
17:21:26 - cmdstanpy - INFO - Chain [1] start processing
17:21:26 - cmdstanpy - INFO - Chain [1] start processing
17:21:26 - cmdstanpy - INFO - Chain [1] start processing
17:21:26 - cmdstanpy - INFO - Chain [1] done processing
17:21:26 - cmdstanpy - INFO - Chain [1] done processing
17:21:27 - cmdstanpy - INFO - Chain [1] done processing
17:21:27 - cmdstanpy - INFO - Chain [1] done processing
17:21:27 - cmdstanpy - INFO - Chain [1] start processing
17:21:27 - cmdstanpy - INFO - Chain [1] done processing
17:21:28 - cmdstanpy - INFO - Chain [1] start processing
17:21:28 - cmdstanpy - INFO - Chain [1] start processing
17:21:28 - cmdstanpy - INFO - Chain [1] start processing
17:21:28 - cmdstanpy - INFO - Chain [1] start processing
17:21:28 - cmdstanpy - INFO - Chain [1] done processing
17:21:28 - cmdstanpy - INFO - Chain [1] done processing
17:21:29 - cmdstanpy - INFO - Chain [1] done processing
17:21:30 - cmdstanpy - INFO - Chain [1] done processing
17:21:30 - cmdstanpy - INFO - Chain [1] start processing
17:21:31 - cmdstanpy - INFO - Chain [1] done processing
17:21:31 - cmdstanpy - INFO - Chain [1] start processing
17:21:32 - cmdstanpy - INFO - Chain [1] start processing
17:21:32 - cmdstanpy - INFO - Chain [1] start processing
17:21:32 - cmdstanpy - INFO - Chain [1] start processing
17:21:32 - cmdstanpy - INFO - Chain [1] done processing
17:21:32 - cmdstanpy - INFO - Chain [1] done processing
17:21:32 - cmdstanpy - INFO - Chain [1] done processing
17:21:32 - cmdstanpy - INFO - Chain [1] done processing
17:21:32 - cmdstanpy - INFO - Chain [1] start processing
17:21:33 - cmdstanpy - INFO - Chain [1] done processing
17:21:34 - cmdstanpy - INFO - Chain [1] start processing
17:21:34 - cmdstanpy - INFO - Chain [1] start processing
17:21:34 - cmdstanpy - INFO - Chain [1] start processing
17:21:34 - cmdstanpy - INFO - Chain [1] start processing
17:21:34 - cmdstanpy - INFO - Chain [1] done processing
17:21:34 - cmdstanpy - INFO - Chain [1] done processing
17:21:34 - cmdstanpy - INFO - Chain [1] done processing
17:21:34 - cmdstanpy - INFO - Chain [1] done processing
17:21:34 - cmdstanpy - INFO - Chain [1] start processing
17:21:34 - cmdstanpy - INFO - Chain [1] done processing
17:21:35 - cmdstanpy - INFO - Chain [1] start processing
17:21:35 - cmdstanpy - INFO - Chain [1] start processing
17:21:35 - cmdstanpy - INFO - Chain [1] start processing
17:21:35 - cmdstanpy - INFO - Chain [1] start processing
17:21:35 - cmdstanpy - INFO - Chain [1] done processing
17:21:36 - cmdstanpy - INFO - Chain [1] done processing
17:21:36 - cmdstanpy - INFO - Chain [1] done processing
17:21:36 - cmdstanpy - INFO - Chain [1] done processing
17:21:36 - cmdstanpy - INFO - Chain [1] start processing
17:21:37 - cmdstanpy - INFO - Chain [1] done processing
17:21:38 - cmdstanpy - INFO - Chain [1] start processing
17:21:38 - cmdstanpy - INFO - Chain [1] start processing
17:21:38 - cmdstanpy - INFO - Chain [1] start processing
17:21:38 - cmdstanpy - INFO - Chain [1] start processing
17:21:38 - cmdstanpy - INFO - Chain [1] done processing
17:21:38 - cmdstanpy - INFO - Chain [1] done processing
17:21:38 - cmdstanpy - INFO - Chain [1] done processing
17:21:38 - cmdstanpy - INFO - Chain [1] done processing
17:21:38 - cmdstanpy - INFO - Chain [1] start processing
17:21:39 - cmdstanpy - INFO - Chain [1] done processing
17:21:40 - cmdstanpy - INFO - Chain [1] start processing
17:21:40 - cmdstanpy - INFO - Chain [1] start processing
17:21:40 - cmdstanpy - INFO - Chain [1] start processing
17:21:40 - cmdstanpy - INFO - Chain [1] start processing
17:21:40 - cmdstanpy - INFO - Chain [1] done processing
17:21:40 - cmdstanpy - INFO - Chain [1] done processing
17:21:40 - cmdstanpy - INFO - Chain [1] done processing
17:21:40 - cmdstanpy - INFO - Chain [1] done processing
17:21:40 - cmdstanpy - INFO - Chain [1] start processing
17:21:41 - cmdstanpy - INFO - Chain [1] done processing
17:21:42 - cmdstanpy - INFO - Chain [1] start processing
17:21:42 - cmdstanpy - INFO - Chain [1] start processing
17:21:42 - cmdstanpy - INFO - Chain [1] start processing
17:21:42 - cmdstanpy - INFO - Chain [1] start processing
17:21:42 - cmdstanpy - INFO - Chain [1] done processing
17:21:42 - cmdstanpy - INFO - Chain [1] done processing
17:21:42 - cmdstanpy - INFO - Chain [1] done processing
17:21:43 - cmdstanpy - INFO - Chain [1] done processing
17:21:44 - cmdstanpy - INFO - Chain [1] start processing
17:21:44 - cmdstanpy - INFO - Chain [1] done processing
17:21:45 - cmdstanpy - INFO - Chain [1] start processing
17:21:45 - cmdstanpy - INFO - Chain [1] start processing
17:21:45 - cmdstanpy - INFO - Chain [1] start processing
17:21:45 - cmdstanpy - INFO - Chain [1] start processing
17:21:45 - cmdstanpy - INFO - Chain [1] done processing
17:21:46 - cmdstanpy - INFO - Chain [1] done processing
17:21:46 - cmdstanpy - INFO - Chain [1] done processing
17:21:46 - cmdstanpy - INFO - Chain [1] done processing
17:21:46 - cmdstanpy - INFO - Chain [1] start processing
17:21:47 - cmdstanpy - INFO - Chain [1] done processing
17:21:47 - cmdstanpy - INFO - Chain [1] start processing
17:21:47 - cmdstanpy - INFO - Chain [1] start processing
17:21:48 - cmdstanpy - INFO - Chain [1] start processing
17:21:48 - cmdstanpy - INFO - Chain [1] start processing
17:21:48 - cmdstanpy - INFO - Chain [1] done processing
17:21:48 - cmdstanpy - INFO - Chain [1] done processing
17:21:48 - cmdstanpy - INFO - Chain [1] done processing
17:21:49 - cmdstanpy - INFO - Chain [1] done processing
17:21:49 - cmdstanpy - INFO - Chain [1] start processing
17:21:50 - cmdstanpy - INFO - Chain [1] done processing
17:21:51 - cmdstanpy - INFO - Chain [1] start processing
17:21:51 - cmdstanpy - INFO - Chain [1] start processing
17:21:51 - cmdstanpy - INFO - Chain [1] start processing
17:21:51 - cmdstanpy - INFO - Chain [1] start processing
17:21:51 - cmdstanpy - INFO - Chain [1] done processing
17:21:52 - cmdstanpy - INFO - Chain [1] done processing
17:21:52 - cmdstanpy - INFO - Chain [1] done processing
17:21:52 - cmdstanpy - INFO - Chain [1] done processing
17:21:52 - cmdstanpy - INFO - Chain [1] start processing
17:21:52 - cmdstanpy - INFO - Chain [1] done processing
17:21:53 - cmdstanpy - INFO - Chain [1] start processing
17:21:53 - cmdstanpy - INFO - Chain [1] start processing
17:21:53 - cmdstanpy - INFO - Chain [1] start processing
17:21:53 - cmdstanpy - INFO - Chain [1] start processing
17:21:53 - cmdstanpy - INFO - Chain [1] done processing
17:21:53 - cmdstanpy - INFO - Chain [1] done processing
17:21:53 - cmdstanpy - INFO - Chain [1] done processing
17:21:53 - cmdstanpy - INFO - Chain [1] done processing
17:21:53 - cmdstanpy - INFO - Chain [1] start processing
17:21:54 - cmdstanpy - INFO - Chain [1] done processing
17:21:55 - cmdstanpy - INFO - Chain [1] start processing
17:21:55 - cmdstanpy - INFO - Chain [1] start processing
17:21:55 - cmdstanpy - INFO - Chain [1] start processing
17:21:55 - cmdstanpy - INFO - Chain [1] start processing
17:21:55 - cmdstanpy - INFO - Chain [1] done processing
17:21:55 - cmdstanpy - INFO - Chain [1] done processing
17:21:55 - cmdstanpy - INFO - Chain [1] done processing
17:21:55 - cmdstanpy - INFO - Chain [1] done processing
17:21:55 - cmdstanpy - INFO - Chain [1] start processing
17:21:56 - cmdstanpy - INFO - Chain [1] done processing
17:21:57 - cmdstanpy - INFO - Chain [1] start processing
17:21:57 - cmdstanpy - INFO - Chain [1] start processing
17:21:57 - cmdstanpy - INFO - Chain [1] start processing
17:21:57 - cmdstanpy - INFO - Chain [1] start processing
17:21:57 - cmdstanpy - INFO - Chain [1] done processing
17:21:57 - cmdstanpy - INFO - Chain [1] done processing
17:21:57 - cmdstanpy - INFO - Chain [1] done processing
17:21:58 - cmdstanpy - INFO - Chain [1] done processing
17:21:58 - cmdstanpy - INFO - Chain [1] start processing
17:21:58 - cmdstanpy - INFO - Chain [1] done processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] done processing
17:21:59 - cmdstanpy - INFO - Chain [1] done processing
17:22:00 - cmdstanpy - INFO - Chain [1] done processing
17:22:00 - cmdstanpy - INFO - Chain [1] done processing
17:22:00 - cmdstanpy - INFO - Chain [1] start processing
17:22:00 - cmdstanpy - INFO - Chain [1] done processing
17:22:01 - cmdstanpy - INFO - Chain [1] start processing
17:22:01 - cmdstanpy - INFO - Chain [1] start processing
17:22:01 - cmdstanpy - INFO - Chain [1] start processing
17:22:01 - cmdstanpy - INFO - Chain [1] start processing
17:22:01 - cmdstanpy - INFO - Chain [1] done processing
17:22:02 - cmdstanpy - INFO - Chain [1] done processing
17:22:02 - cmdstanpy - INFO - Chain [1] done processing
17:22:03 - cmdstanpy - INFO - Chain [1] done processing
17:22:03 - cmdstanpy - INFO - Chain [1] start processing
17:22:04 - cmdstanpy - INFO - Chain [1] done processing
17:22:04 - cmdstanpy - INFO - Chain [1] start processing
17:22:04 - cmdstanpy - INFO - Chain [1] start processing
17:22:05 - cmdstanpy - INFO - Chain [1] start processing
17:22:05 - cmdstanpy - INFO - Chain [1] start processing
17:22:05 - cmdstanpy - INFO - Chain [1] done processing
17:22:05 - cmdstanpy - INFO - Chain [1] done processing
17:22:05 - cmdstanpy - INFO - Chain [1] done processing
17:22:05 - cmdstanpy - INFO - Chain [1] done processing
17:22:06 - cmdstanpy - INFO - Chain [1] start processing
17:22:06 - cmdstanpy - INFO - Chain [1] done processing
17:22:07 - cmdstanpy - INFO - Chain [1] start processing
17:22:07 - cmdstanpy - INFO - Chain [1] start processing
17:22:07 - cmdstanpy - INFO - Chain [1] start processing
17:22:07 - cmdstanpy - INFO - Chain [1] start processing
17:22:07 - cmdstanpy - INFO - Chain [1] done processing
17:22:07 - cmdstanpy - INFO - Chain [1] done processing
17:22:08 - cmdstanpy - INFO - Chain [1] done processing
17:22:08 - cmdstanpy - INFO - Chain [1] done processing
17:22:09 - cmdstanpy - INFO - Chain [1] start processing
17:22:09 - cmdstanpy - INFO - Chain [1] done processing
17:22:10 - cmdstanpy - INFO - Chain [1] start processing
17:22:10 - cmdstanpy - INFO - Chain [1] start processing
17:22:10 - cmdstanpy - INFO - Chain [1] start processing
17:22:10 - cmdstanpy - INFO - Chain [1] start processing
17:22:11 - cmdstanpy - INFO - Chain [1] done processing
17:22:11 - cmdstanpy - INFO - Chain [1] done processing
17:22:11 - cmdstanpy - INFO - Chain [1] done processing
17:22:11 - cmdstanpy - INFO - Chain [1] done processing
17:22:11 - cmdstanpy - INFO - Chain [1] start processing
17:22:12 - cmdstanpy - INFO - Chain [1] done processing
17:22:13 - cmdstanpy - INFO - Chain [1] start processing
17:22:13 - cmdstanpy - INFO - Chain [1] start processing
17:22:13 - cmdstanpy - INFO - Chain [1] start processing
17:22:13 - cmdstanpy - INFO - Chain [1] start processing
17:22:13 - cmdstanpy - INFO - Chain [1] done processing
17:22:14 - cmdstanpy - INFO - Chain [1] done processing
17:22:14 - cmdstanpy - INFO - Chain [1] done processing
17:22:23 - cmdstanpy - INFO - Chain [1] done processing
17:22:23 - cmdstanpy - INFO - Chain [1] start processing
17:22:24 - cmdstanpy - INFO - Chain [1] done processing
17:22:25 - cmdstanpy - INFO - Chain [1] start processing
17:22:25 - cmdstanpy - INFO - Chain [1] start processing
17:22:25 - cmdstanpy - INFO - Chain [1] start processing
17:22:25 - cmdstanpy - INFO - Chain [1] start processing
17:22:26 - cmdstanpy - INFO - Chain [1] done processing
17:22:26 - cmdstanpy - INFO - Chain [1] done processing
17:22:26 - cmdstanpy - INFO - Chain [1] done processing
17:22:26 - cmdstanpy - INFO - Chain [1] done processing
17:22:26 - cmdstanpy - INFO - Chain [1] start processing
17:22:27 - cmdstanpy - INFO - Chain [1] done processing
17:22:28 - cmdstanpy - INFO - Chain [1] start processing
17:22:28 - cmdstanpy - INFO - Chain [1] start processing
17:22:28 - cmdstanpy - INFO - Chain [1] start processing
17:22:28 - cmdstanpy - INFO - Chain [1] start processing
17:22:29 - cmdstanpy - INFO - Chain [1] done processing
17:22:29 - cmdstanpy - INFO - Chain [1] done processing
17:22:29 - cmdstanpy - INFO - Chain [1] done processing
17:22:39 - cmdstanpy - INFO - Chain [1] done processing
17:22:39 - cmdstanpy - INFO - Chain [1] start processing
17:22:40 - cmdstanpy - INFO - Chain [1] done processing
17:22:41 - cmdstanpy - INFO - Chain [1] start processing
17:22:41 - cmdstanpy - INFO - Chain [1] start processing
17:22:41 - cmdstanpy - INFO - Chain [1] start processing
17:22:41 - cmdstanpy - INFO - Chain [1] start processing
17:22:41 - cmdstanpy - INFO - Chain [1] done processing
17:22:42 - cmdstanpy - INFO - Chain [1] done processing
17:22:42 - cmdstanpy - INFO - Chain [1] done processing
17:22:42 - cmdstanpy - INFO - Chain [1] done processing
17:22:42 - cmdstanpy - INFO - Chain [1] start processing
17:22:44 - cmdstanpy - INFO - Chain [1] done processing
17:22:45 - cmdstanpy - INFO - Chain [1] start processing
17:22:45 - cmdstanpy - INFO - Chain [1] start processing
17:22:45 - cmdstanpy - INFO - Chain [1] start processing
17:22:45 - cmdstanpy - INFO - Chain [1] start processing
17:22:45 - cmdstanpy - INFO - Chain [1] done processing
17:22:46 - cmdstanpy - INFO - Chain [1] done processing
17:22:47 - cmdstanpy - INFO - Chain [1] done processing
17:22:55 - cmdstanpy - INFO - Chain [1] done processing
17:22:55 - cmdstanpy - INFO - Chain [1] start processing
17:22:57 - cmdstanpy - INFO - Chain [1] done processing
17:22:57 - cmdstanpy - INFO - Chain [1] start processing
17:22:58 - cmdstanpy - INFO - Chain [1] start processing
17:22:58 - cmdstanpy - INFO - Chain [1] start processing
17:22:58 - cmdstanpy - INFO - Chain [1] start processing
17:22:59 - cmdstanpy - INFO - Chain [1] done processing
17:22:59 - cmdstanpy - INFO - Chain [1] done processing
17:22:59 - cmdstanpy - INFO - Chain [1] done processing
17:23:08 - cmdstanpy - INFO - Chain [1] done processing
17:23:08 - cmdstanpy - INFO - Chain [1] start processing
17:23:10 - cmdstanpy - INFO - Chain [1] done processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:12 - cmdstanpy - INFO - Chain [1] done processing
17:23:12 - cmdstanpy - INFO - Chain [1] done processing
17:23:13 - cmdstanpy - INFO - Chain [1] done processing
17:23:22 - cmdstanpy - INFO - Chain [1] done processing
17:23:22 - cmdstanpy - INFO - Chain [1] start processing
17:23:24 - cmdstanpy - INFO - Chain [1] done processing
17:23:24 - cmdstanpy - INFO - Chain [1] start processing
17:23:25 - cmdstanpy - INFO - Chain [1] start processing
17:23:25 - cmdstanpy - INFO - Chain [1] start processing
17:23:25 - cmdstanpy - INFO - Chain [1] start processing
17:23:25 - cmdstanpy - INFO - Chain [1] done processing
17:23:26 - cmdstanpy - INFO - Chain [1] done processing
17:23:27 - cmdstanpy - INFO - Chain [1] done processing
17:23:35 - cmdstanpy - INFO - Chain [1] done processing
17:23:35 - cmdstanpy - INFO - Chain [1] start processing
17:23:36 - cmdstanpy - INFO - Chain [1] done processing
17:23:37 - cmdstanpy - INFO - Chain [1] start processing
17:23:37 - cmdstanpy - INFO - Chain [1] start processing
17:23:37 - cmdstanpy - INFO - Chain [1] start processing
17:23:37 - cmdstanpy - INFO - Chain [1] start processing
17:23:38 - cmdstanpy - INFO - Chain [1] done processing
17:23:38 - cmdstanpy - INFO - Chain [1] done processing
17:23:38 - cmdstanpy - INFO - Chain [1] done processing
17:23:48 - cmdstanpy - INFO - Chain [1] done processing
17:23:48 - cmdstanpy - INFO - Chain [1] start processing
17:23:49 - cmdstanpy - INFO - Chain [1] done processing
17:23:50 - cmdstanpy - INFO - Chain [1] start processing
17:23:50 - cmdstanpy - INFO - Chain [1] start processing
17:23:50 - cmdstanpy - INFO - Chain [1] start processing
17:23:50 - cmdstanpy - INFO - Chain [1] start processing
17:23:50 - cmdstanpy - INFO - Chain [1] done processing
17:23:50 - cmdstanpy - INFO - Chain [1] done processing
17:23:50 - cmdstanpy - INFO - Chain [1] done processing
17:23:51 - cmdstanpy - INFO - Chain [1] done processing
17:23:51 - cmdstanpy - INFO - Chain [1] start processing
17:23:52 - cmdstanpy - INFO - Chain [1] done processing
17:23:53 - cmdstanpy - INFO - Chain [1] start processing
17:23:53 - cmdstanpy - INFO - Chain [1] start processing
17:23:53 - cmdstanpy - INFO - Chain [1] start processing
17:23:53 - cmdstanpy - INFO - Chain [1] start processing
17:23:53 - cmdstanpy - INFO - Chain [1] done processing
17:23:53 - cmdstanpy - INFO - Chain [1] done processing
17:23:54 - cmdstanpy - INFO - Chain [1] done processing
17:24:03 - cmdstanpy - INFO - Chain [1] done processing
17:24:03 - cmdstanpy - INFO - Chain [1] start processing
17:24:04 - cmdstanpy - INFO - Chain [1] done processing
17:24:05 - cmdstanpy - INFO - Chain [1] start processing
17:24:05 - cmdstanpy - INFO - Chain [1] start processing
17:24:05 - cmdstanpy - INFO - Chain [1] start processing
17:24:05 - cmdstanpy - INFO - Chain [1] start processing
17:24:06 - cmdstanpy - INFO - Chain [1] done processing
17:24:06 - cmdstanpy - INFO - Chain [1] done processing
17:24:06 - cmdstanpy - INFO - Chain [1] done processing
17:24:07 - cmdstanpy - INFO - Chain [1] done processing
17:24:07 - cmdstanpy - INFO - Chain [1] start processing
17:24:08 - cmdstanpy - INFO - Chain [1] done processing
17:24:09 - cmdstanpy - INFO - Chain [1] start processing
17:24:09 - cmdstanpy - INFO - Chain [1] start processing
17:24:09 - cmdstanpy - INFO - Chain [1] start processing
17:24:09 - cmdstanpy - INFO - Chain [1] start processing
17:24:10 - cmdstanpy - INFO - Chain [1] done processing
17:24:11 - cmdstanpy - INFO - Chain [1] done processing
17:24:11 - cmdstanpy - INFO - Chain [1] done processing
17:24:20 - cmdstanpy - INFO - Chain [1] done processing
17:24:20 - cmdstanpy - INFO - Chain [1] start processing
17:24:21 - cmdstanpy - INFO - Chain [1] done processing
17:24:22 - cmdstanpy - INFO - Chain [1] start processing
17:24:22 - cmdstanpy - INFO - Chain [1] start processing
17:24:22 - cmdstanpy - INFO - Chain [1] start processing
17:24:22 - cmdstanpy - INFO - Chain [1] start processing
17:24:23 - cmdstanpy - INFO - Chain [1] done processing
17:24:23 - cmdstanpy - INFO - Chain [1] done processing
17:24:24 - cmdstanpy - INFO - Chain [1] done processing
17:24:32 - cmdstanpy - INFO - Chain [1] done processing
17:24:32 - cmdstanpy - INFO - Chain [1] start processing
17:24:34 - cmdstanpy - INFO - Chain [1] done processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:36 - cmdstanpy - INFO - Chain [1] done processing
17:24:36 - cmdstanpy - INFO - Chain [1] done processing
17:24:37 - cmdstanpy - INFO - Chain [1] done processing
17:24:46 - cmdstanpy - INFO - Chain [1] done processing
17:24:46 - cmdstanpy - INFO - Chain [1] start processing
17:24:48 - cmdstanpy - INFO - Chain [1] done processing
17:24:49 - cmdstanpy - INFO - Chain [1] start processing
17:24:49 - cmdstanpy - INFO - Chain [1] start processing
17:24:49 - cmdstanpy - INFO - Chain [1] start processing
17:24:49 - cmdstanpy - INFO - Chain [1] start processing
17:24:50 - cmdstanpy - INFO - Chain [1] done processing
17:24:50 - cmdstanpy - INFO - Chain [1] done processing
17:24:51 - cmdstanpy - INFO - Chain [1] done processing
17:25:00 - cmdstanpy - INFO - Chain [1] done processing
17:25:00 - cmdstanpy - INFO - Chain [1] start processing
17:25:00 - cmdstanpy - INFO - Chain [1] done processing
17:25:01 - cmdstanpy - INFO - Chain [1] start processing
17:25:01 - cmdstanpy - INFO - Chain [1] start processing
17:25:01 - cmdstanpy - INFO - Chain [1] start processing
17:25:01 - cmdstanpy - INFO - Chain [1] start processing
17:25:02 - cmdstanpy - INFO - Chain [1] done processing
17:25:02 - cmdstanpy - INFO - Chain [1] done processing
17:25:02 - cmdstanpy - INFO - Chain [1] done processing
17:25:12 - cmdstanpy - INFO - Chain [1] done processing
17:25:12 - cmdstanpy - INFO - Chain [1] start processing
17:25:13 - cmdstanpy - INFO - Chain [1] done processing
17:25:14 - cmdstanpy - INFO - Chain [1] start processing
17:25:14 - cmdstanpy - INFO - Chain [1] start processing
17:25:14 - cmdstanpy - INFO - Chain [1] start processing
17:25:14 - cmdstanpy - INFO - Chain [1] start processing
17:25:14 - cmdstanpy - INFO - Chain [1] done processing
17:25:14 - cmdstanpy - INFO - Chain [1] done processing
17:25:15 - cmdstanpy - INFO - Chain [1] done processing
17:25:15 - cmdstanpy - INFO - Chain [1] done processing
17:25:15 - cmdstanpy - INFO - Chain [1] start processing
17:25:16 - cmdstanpy - INFO - Chain [1] done processing
17:25:17 - cmdstanpy - INFO - Chain [1] start processing
17:25:17 - cmdstanpy - INFO - Chain [1] start processing
17:25:17 - cmdstanpy - INFO - Chain [1] start processing
17:25:17 - cmdstanpy - INFO - Chain [1] start processing
17:25:17 - cmdstanpy - INFO - Chain [1] done processing
17:25:18 - cmdstanpy - INFO - Chain [1] done processing
17:25:18 - cmdstanpy - INFO - Chain [1] done processing
17:25:27 - cmdstanpy - INFO - Chain [1] done processing
17:25:27 - cmdstanpy - INFO - Chain [1] start processing
17:25:28 - cmdstanpy - INFO - Chain [1] done processing
17:25:29 - cmdstanpy - INFO - Chain [1] start processing
17:25:29 - cmdstanpy - INFO - Chain [1] start processing
17:25:29 - cmdstanpy - INFO - Chain [1] start processing
17:25:29 - cmdstanpy - INFO - Chain [1] start processing
17:25:30 - cmdstanpy - INFO - Chain [1] done processing
17:25:30 - cmdstanpy - INFO - Chain [1] done processing
17:25:31 - cmdstanpy - INFO - Chain [1] done processing
17:25:31 - cmdstanpy - INFO - Chain [1] done processing
17:25:31 - cmdstanpy - INFO - Chain [1] start processing
17:25:32 - cmdstanpy - INFO - Chain [1] done processing
17:25:33 - cmdstanpy - INFO - Chain [1] start processing
17:25:33 - cmdstanpy - INFO - Chain [1] start processing
17:25:33 - cmdstanpy - INFO - Chain [1] start processing
17:25:33 - cmdstanpy - INFO - Chain [1] start processing
17:25:34 - cmdstanpy - INFO - Chain [1] done processing
17:25:35 - cmdstanpy - INFO - Chain [1] done processing
17:25:35 - cmdstanpy - INFO - Chain [1] done processing
17:25:44 - cmdstanpy - INFO - Chain [1] done processing
17:25:44 - cmdstanpy - INFO - Chain [1] start processing
17:25:45 - cmdstanpy - INFO - Chain [1] done processing
17:25:46 - cmdstanpy - INFO - Chain [1] start processing
17:25:46 - cmdstanpy - INFO - Chain [1] start processing
17:25:46 - cmdstanpy - INFO - Chain [1] start processing
17:25:46 - cmdstanpy - INFO - Chain [1] start processing
17:25:47 - cmdstanpy - INFO - Chain [1] done processing
17:25:47 - cmdstanpy - INFO - Chain [1] done processing
17:25:48 - cmdstanpy - INFO - Chain [1] done processing
17:25:57 - cmdstanpy - INFO - Chain [1] done processing
17:25:57 - cmdstanpy - INFO - Chain [1] start processing
17:25:58 - cmdstanpy - INFO - Chain [1] done processing
17:25:59 - cmdstanpy - INFO - Chain [1] start processing
17:25:59 - cmdstanpy - INFO - Chain [1] start processing
17:25:59 - cmdstanpy - INFO - Chain [1] start processing
17:25:59 - cmdstanpy - INFO - Chain [1] start processing
17:26:00 - cmdstanpy - INFO - Chain [1] done processing
17:26:00 - cmdstanpy - INFO - Chain [1] done processing
17:26:01 - cmdstanpy - INFO - Chain [1] done processing
17:26:10 - cmdstanpy - INFO - Chain [1] done processing
17:26:10 - cmdstanpy - INFO - Chain [1] start processing
17:26:12 - cmdstanpy - INFO - Chain [1] done processing
17:26:13 - cmdstanpy - INFO - Chain [1] start processing
17:26:13 - cmdstanpy - INFO - Chain [1] start processing
17:26:13 - cmdstanpy - INFO - Chain [1] start processing
17:26:13 - cmdstanpy - INFO - Chain [1] start processing
17:26:14 - cmdstanpy - INFO - Chain [1] done processing
17:26:15 - cmdstanpy - INFO - Chain [1] done processing
17:26:15 - cmdstanpy - INFO - Chain [1] done processing
17:26:24 - cmdstanpy - INFO - Chain [1] done processing
17:26:24 - cmdstanpy - INFO - Chain [1] start processing
17:26:25 - cmdstanpy - INFO - Chain [1] done processing
17:26:25 - cmdstanpy - INFO - Chain [1] start processing
17:26:25 - cmdstanpy - INFO - Chain [1] start processing
17:26:25 - cmdstanpy - INFO - Chain [1] start processing
17:26:25 - cmdstanpy - INFO - Chain [1] start processing
17:26:26 - cmdstanpy - INFO - Chain [1] done processing
17:26:26 - cmdstanpy - INFO - Chain [1] done processing
17:26:26 - cmdstanpy - INFO - Chain [1] done processing
17:26:36 - cmdstanpy - INFO - Chain [1] done processing
17:26:36 - cmdstanpy - INFO - Chain [1] start processing
17:26:37 - cmdstanpy - INFO - Chain [1] done processing
17:26:38 - cmdstanpy - INFO - Chain [1] start processing
17:26:38 - cmdstanpy - INFO - Chain [1] start processing
17:26:38 - cmdstanpy - INFO - Chain [1] start processing
17:26:38 - cmdstanpy - INFO - Chain [1] start processing
17:26:38 - cmdstanpy - INFO - Chain [1] done processing
17:26:38 - cmdstanpy - INFO - Chain [1] done processing
17:26:39 - cmdstanpy - INFO - Chain [1] done processing
17:26:39 - cmdstanpy - INFO - Chain [1] done processing
17:26:39 - cmdstanpy - INFO - Chain [1] start processing
17:26:40 - cmdstanpy - INFO - Chain [1] done processing
17:26:41 - cmdstanpy - INFO - Chain [1] start processing
17:26:41 - cmdstanpy - INFO - Chain [1] start processing
17:26:41 - cmdstanpy - INFO - Chain [1] start processing
17:26:41 - cmdstanpy - INFO - Chain [1] start processing
17:26:42 - cmdstanpy - INFO - Chain [1] done processing
17:26:42 - cmdstanpy - INFO - Chain [1] done processing
17:26:42 - cmdstanpy - INFO - Chain [1] done processing
17:26:51 - cmdstanpy - INFO - Chain [1] done processing
17:26:52 - cmdstanpy - INFO - Chain [1] start processing
17:26:53 - cmdstanpy - INFO - Chain [1] done processing
17:26:53 - cmdstanpy - INFO - Chain [1] start processing
17:26:54 - cmdstanpy - INFO - Chain [1] start processing
17:26:54 - cmdstanpy - INFO - Chain [1] start processing
17:26:54 - cmdstanpy - INFO - Chain [1] start processing
17:26:54 - cmdstanpy - INFO - Chain [1] done processing
17:26:54 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] start processing
17:26:56 - cmdstanpy - INFO - Chain [1] done processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:58 - cmdstanpy - INFO - Chain [1] done processing
17:26:59 - cmdstanpy - INFO - Chain [1] done processing
17:26:59 - cmdstanpy - INFO - Chain [1] done processing
17:27:08 - cmdstanpy - INFO - Chain [1] done processing
17:27:08 - cmdstanpy - INFO - Chain [1] start processing
17:27:09 - cmdstanpy - INFO - Chain [1] done processing
17:27:10 - cmdstanpy - INFO - Chain [1] start processing
17:27:10 - cmdstanpy - INFO - Chain [1] start processing
17:27:10 - cmdstanpy - INFO - Chain [1] start processing
17:27:10 - cmdstanpy - INFO - Chain [1] start processing
17:27:12 - cmdstanpy - INFO - Chain [1] done processing
17:27:12 - cmdstanpy - INFO - Chain [1] done processing
17:27:12 - cmdstanpy - INFO - Chain [1] done processing
17:27:21 - cmdstanpy - INFO - Chain [1] done processing
17:27:21 - cmdstanpy - INFO - Chain [1] start processing
17:27:23 - cmdstanpy - INFO - Chain [1] done processing
17:27:23 - cmdstanpy - INFO - Chain [1] start processing
17:27:23 - cmdstanpy - INFO - Chain [1] start processing
17:27:24 - cmdstanpy - INFO - Chain [1] start processing
17:27:24 - cmdstanpy - INFO - Chain [1] start processing
17:27:24 - cmdstanpy - INFO - Chain [1] done processing
17:27:24 - cmdstanpy - INFO - Chain [1] done processing
17:27:25 - cmdstanpy - INFO - Chain [1] done processing
17:27:34 - cmdstanpy - INFO - Chain [1] done processing
17:27:34 - cmdstanpy - INFO - Chain [1] start processing
17:27:36 - cmdstanpy - INFO - Chain [1] done processing
17:27:37 - cmdstanpy - INFO - Chain [1] start processing
17:27:37 - cmdstanpy - INFO - Chain [1] start processing
17:27:37 - cmdstanpy - INFO - Chain [1] start processing
17:27:37 - cmdstanpy - INFO - Chain [1] start processing
17:27:38 - cmdstanpy - INFO - Chain [1] done processing
17:27:39 - cmdstanpy - INFO - Chain [1] done processing
17:27:39 - cmdstanpy - INFO - Chain [1] done processing
Best parameters: {'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01, 'seasonality_mode': 'multiplicative'}
17:27:48 - cmdstanpy - INFO - Chain [1] done processing
Code
# Refit the model with the best parameters
final_model = Prophet(growth='logistic', **best_params1)
final_model.add_country_holidays(country_name='US')
for feature in features:
    final_model.add_regressor(feature)
final_model.fit(train.assign(cap=1, floor=0))

# Predict on the training set
train_forecast = final_model.predict(train)
train_rmse = sqrt(mean_squared_error(train['y'], train_forecast['yhat']))

# Predict on the test set
test_forecast = final_model.predict(test)
test_rmse = sqrt(mean_squared_error(test['y'], test_forecast['yhat']))

print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")
# Retrieve and print the cross-validated RMSE of the best model
best_rmse_index = np.argmin(rmses)
best_rmse = rmses[best_rmse_index]
print(f"Cross-validated RMSE of the best model: {best_rmse}")
17:27:48 - cmdstanpy - INFO - Chain [1] start processing
17:27:49 - cmdstanpy - INFO - Chain [1] done processing
Train RMSE: 0.010021219867086121
Test RMSE: 0.01684613527712839
Cross-validated RMSE of the best model: 0.011242406258430045

Here, we can see that the test RMSE greatly decreased and is very similar to the train RMSE. The best parameters I got are as follows:

'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01, 'seasonality_mode': 'multiplicative'.

Below I tune the model once more to be exhaustive.

Code
# Updated parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.3, 0.4, 0.45, 0.5],
    'seasonality_prior_scale': [0.01, 0.015, 0.02, 0.025],
    'holidays_prior_scale': [0.01, 0.015, 0.02, 0.025]
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each set of parameters 

# Cross-validation to evaluate all parameters
for params in all_params:
    # Initialize Prophet model with logistic growth and additive seasonality
    m = Prophet(growth='logistic', seasonality_mode='multiplicative', **params)
    m.add_country_holidays(country_name='US')
    
    # Add each additional regressor
    for feature in features:
        m.add_regressor(feature)
    
    # Fit the model to the training data
    m.fit(train.assign(cap=1, floor=0))

    # Perform cross-validation
    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)

    # Store the RMSE for each parameter set
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params}")
17:27:49 - cmdstanpy - INFO - Chain [1] start processing
17:27:50 - cmdstanpy - INFO - Chain [1] done processing
17:27:51 - cmdstanpy - INFO - Chain [1] start processing
17:27:51 - cmdstanpy - INFO - Chain [1] start processing
17:27:51 - cmdstanpy - INFO - Chain [1] start processing
17:27:51 - cmdstanpy - INFO - Chain [1] start processing
17:27:51 - cmdstanpy - INFO - Chain [1] done processing
17:27:51 - cmdstanpy - INFO - Chain [1] done processing
17:27:51 - cmdstanpy - INFO - Chain [1] done processing
17:27:51 - cmdstanpy - INFO - Chain [1] done processing
17:27:51 - cmdstanpy - INFO - Chain [1] start processing
17:27:52 - cmdstanpy - INFO - Chain [1] done processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] done processing
17:27:54 - cmdstanpy - INFO - Chain [1] done processing
17:27:54 - cmdstanpy - INFO - Chain [1] done processing
17:27:55 - cmdstanpy - INFO - Chain [1] done processing
17:27:55 - cmdstanpy - INFO - Chain [1] start processing
17:27:56 - cmdstanpy - INFO - Chain [1] done processing
17:27:57 - cmdstanpy - INFO - Chain [1] start processing
17:27:57 - cmdstanpy - INFO - Chain [1] start processing
17:27:57 - cmdstanpy - INFO - Chain [1] start processing
17:27:57 - cmdstanpy - INFO - Chain [1] start processing
17:27:57 - cmdstanpy - INFO - Chain [1] done processing
17:27:57 - cmdstanpy - INFO - Chain [1] done processing
17:27:58 - cmdstanpy - INFO - Chain [1] done processing
17:27:58 - cmdstanpy - INFO - Chain [1] done processing
17:27:58 - cmdstanpy - INFO - Chain [1] start processing
17:27:59 - cmdstanpy - INFO - Chain [1] done processing
17:28:00 - cmdstanpy - INFO - Chain [1] start processing
17:28:00 - cmdstanpy - INFO - Chain [1] start processing
17:28:00 - cmdstanpy - INFO - Chain [1] start processing
17:28:00 - cmdstanpy - INFO - Chain [1] start processing
17:28:00 - cmdstanpy - INFO - Chain [1] done processing
17:28:00 - cmdstanpy - INFO - Chain [1] done processing
17:28:00 - cmdstanpy - INFO - Chain [1] done processing
17:28:00 - cmdstanpy - INFO - Chain [1] done processing
17:28:01 - cmdstanpy - INFO - Chain [1] start processing
17:28:01 - cmdstanpy - INFO - Chain [1] done processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] done processing
17:28:03 - cmdstanpy - INFO - Chain [1] done processing
17:28:03 - cmdstanpy - INFO - Chain [1] done processing
17:28:03 - cmdstanpy - INFO - Chain [1] done processing
17:28:03 - cmdstanpy - INFO - Chain [1] start processing
17:28:04 - cmdstanpy - INFO - Chain [1] done processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] done processing
17:28:05 - cmdstanpy - INFO - Chain [1] done processing
17:28:05 - cmdstanpy - INFO - Chain [1] done processing
17:28:06 - cmdstanpy - INFO - Chain [1] done processing
17:28:06 - cmdstanpy - INFO - Chain [1] start processing
17:28:07 - cmdstanpy - INFO - Chain [1] done processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:09 - cmdstanpy - INFO - Chain [1] done processing
17:28:09 - cmdstanpy - INFO - Chain [1] done processing
17:28:09 - cmdstanpy - INFO - Chain [1] done processing
17:28:09 - cmdstanpy - INFO - Chain [1] done processing
17:28:09 - cmdstanpy - INFO - Chain [1] start processing
17:28:10 - cmdstanpy - INFO - Chain [1] done processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] done processing
17:28:12 - cmdstanpy - INFO - Chain [1] done processing
17:28:12 - cmdstanpy - INFO - Chain [1] done processing
17:28:12 - cmdstanpy - INFO - Chain [1] done processing
17:28:12 - cmdstanpy - INFO - Chain [1] start processing
17:28:13 - cmdstanpy - INFO - Chain [1] done processing
17:28:13 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] done processing
17:28:14 - cmdstanpy - INFO - Chain [1] done processing
17:28:14 - cmdstanpy - INFO - Chain [1] done processing
17:28:14 - cmdstanpy - INFO - Chain [1] done processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:15 - cmdstanpy - INFO - Chain [1] done processing
17:28:16 - cmdstanpy - INFO - Chain [1] start processing
17:28:16 - cmdstanpy - INFO - Chain [1] start processing
17:28:16 - cmdstanpy - INFO - Chain [1] start processing
17:28:16 - cmdstanpy - INFO - Chain [1] start processing
17:28:16 - cmdstanpy - INFO - Chain [1] done processing
17:28:17 - cmdstanpy - INFO - Chain [1] done processing
17:28:17 - cmdstanpy - INFO - Chain [1] done processing
17:28:17 - cmdstanpy - INFO - Chain [1] done processing
17:28:17 - cmdstanpy - INFO - Chain [1] start processing
17:28:19 - cmdstanpy - INFO - Chain [1] done processing
17:28:19 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] done processing
17:28:20 - cmdstanpy - INFO - Chain [1] done processing
17:28:20 - cmdstanpy - INFO - Chain [1] done processing
17:28:20 - cmdstanpy - INFO - Chain [1] done processing
17:28:21 - cmdstanpy - INFO - Chain [1] start processing
17:28:21 - cmdstanpy - INFO - Chain [1] done processing
17:28:22 - cmdstanpy - INFO - Chain [1] start processing
17:28:22 - cmdstanpy - INFO - Chain [1] start processing
17:28:22 - cmdstanpy - INFO - Chain [1] start processing
17:28:22 - cmdstanpy - INFO - Chain [1] start processing
17:28:23 - cmdstanpy - INFO - Chain [1] done processing
17:28:23 - cmdstanpy - INFO - Chain [1] done processing
17:28:23 - cmdstanpy - INFO - Chain [1] done processing
17:28:23 - cmdstanpy - INFO - Chain [1] done processing
17:28:23 - cmdstanpy - INFO - Chain [1] start processing
17:28:24 - cmdstanpy - INFO - Chain [1] done processing
17:28:25 - cmdstanpy - INFO - Chain [1] start processing
17:28:25 - cmdstanpy - INFO - Chain [1] start processing
17:28:25 - cmdstanpy - INFO - Chain [1] start processing
17:28:25 - cmdstanpy - INFO - Chain [1] start processing
17:28:25 - cmdstanpy - INFO - Chain [1] done processing
17:28:25 - cmdstanpy - INFO - Chain [1] done processing
17:28:25 - cmdstanpy - INFO - Chain [1] done processing
17:28:25 - cmdstanpy - INFO - Chain [1] done processing
17:28:25 - cmdstanpy - INFO - Chain [1] start processing
17:28:26 - cmdstanpy - INFO - Chain [1] done processing
17:28:27 - cmdstanpy - INFO - Chain [1] start processing
17:28:27 - cmdstanpy - INFO - Chain [1] start processing
17:28:27 - cmdstanpy - INFO - Chain [1] start processing
17:28:27 - cmdstanpy - INFO - Chain [1] start processing
17:28:28 - cmdstanpy - INFO - Chain [1] done processing
17:28:28 - cmdstanpy - INFO - Chain [1] done processing
17:28:28 - cmdstanpy - INFO - Chain [1] done processing
17:28:29 - cmdstanpy - INFO - Chain [1] done processing
17:28:29 - cmdstanpy - INFO - Chain [1] start processing
17:28:30 - cmdstanpy - INFO - Chain [1] done processing
17:28:31 - cmdstanpy - INFO - Chain [1] start processing
17:28:31 - cmdstanpy - INFO - Chain [1] start processing
17:28:31 - cmdstanpy - INFO - Chain [1] start processing
17:28:31 - cmdstanpy - INFO - Chain [1] start processing
17:28:31 - cmdstanpy - INFO - Chain [1] done processing
17:28:31 - cmdstanpy - INFO - Chain [1] done processing
17:28:32 - cmdstanpy - INFO - Chain [1] done processing
17:28:32 - cmdstanpy - INFO - Chain [1] done processing
17:28:32 - cmdstanpy - INFO - Chain [1] start processing
17:28:33 - cmdstanpy - INFO - Chain [1] done processing
17:28:34 - cmdstanpy - INFO - Chain [1] start processing
17:28:34 - cmdstanpy - INFO - Chain [1] start processing
17:28:34 - cmdstanpy - INFO - Chain [1] start processing
17:28:34 - cmdstanpy - INFO - Chain [1] start processing
17:28:34 - cmdstanpy - INFO - Chain [1] done processing
17:28:34 - cmdstanpy - INFO - Chain [1] done processing
17:28:35 - cmdstanpy - INFO - Chain [1] done processing
17:28:35 - cmdstanpy - INFO - Chain [1] done processing
17:28:35 - cmdstanpy - INFO - Chain [1] start processing
17:28:36 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] start processing
17:28:37 - cmdstanpy - INFO - Chain [1] start processing
17:28:37 - cmdstanpy - INFO - Chain [1] start processing
17:28:37 - cmdstanpy - INFO - Chain [1] start processing
17:28:37 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] start processing
17:28:39 - cmdstanpy - INFO - Chain [1] done processing
17:28:39 - cmdstanpy - INFO - Chain [1] start processing
17:28:40 - cmdstanpy - INFO - Chain [1] start processing
17:28:40 - cmdstanpy - INFO - Chain [1] start processing
17:28:40 - cmdstanpy - INFO - Chain [1] start processing
17:28:40 - cmdstanpy - INFO - Chain [1] done processing
17:28:40 - cmdstanpy - INFO - Chain [1] done processing
17:28:41 - cmdstanpy - INFO - Chain [1] done processing
17:28:41 - cmdstanpy - INFO - Chain [1] done processing
17:28:41 - cmdstanpy - INFO - Chain [1] start processing
17:28:42 - cmdstanpy - INFO - Chain [1] done processing
17:28:43 - cmdstanpy - INFO - Chain [1] start processing
17:28:43 - cmdstanpy - INFO - Chain [1] start processing
17:28:43 - cmdstanpy - INFO - Chain [1] start processing
17:28:43 - cmdstanpy - INFO - Chain [1] start processing
17:28:43 - cmdstanpy - INFO - Chain [1] done processing
17:28:43 - cmdstanpy - INFO - Chain [1] done processing
17:28:44 - cmdstanpy - INFO - Chain [1] done processing
17:28:44 - cmdstanpy - INFO - Chain [1] done processing
17:28:44 - cmdstanpy - INFO - Chain [1] start processing
17:28:45 - cmdstanpy - INFO - Chain [1] done processing
17:28:46 - cmdstanpy - INFO - Chain [1] start processing
17:28:46 - cmdstanpy - INFO - Chain [1] start processing
17:28:46 - cmdstanpy - INFO - Chain [1] start processing
17:28:46 - cmdstanpy - INFO - Chain [1] start processing
17:28:46 - cmdstanpy - INFO - Chain [1] done processing
17:28:47 - cmdstanpy - INFO - Chain [1] done processing
17:28:47 - cmdstanpy - INFO - Chain [1] done processing
17:28:47 - cmdstanpy - INFO - Chain [1] done processing
17:28:47 - cmdstanpy - INFO - Chain [1] start processing
17:28:48 - cmdstanpy - INFO - Chain [1] done processing
17:28:49 - cmdstanpy - INFO - Chain [1] start processing
17:28:49 - cmdstanpy - INFO - Chain [1] start processing
17:28:49 - cmdstanpy - INFO - Chain [1] start processing
17:28:49 - cmdstanpy - INFO - Chain [1] start processing
17:28:49 - cmdstanpy - INFO - Chain [1] done processing
17:28:49 - cmdstanpy - INFO - Chain [1] done processing
17:28:50 - cmdstanpy - INFO - Chain [1] done processing
17:28:50 - cmdstanpy - INFO - Chain [1] done processing
17:28:50 - cmdstanpy - INFO - Chain [1] start processing
17:28:51 - cmdstanpy - INFO - Chain [1] done processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] done processing
17:28:52 - cmdstanpy - INFO - Chain [1] done processing
17:28:53 - cmdstanpy - INFO - Chain [1] done processing
17:28:53 - cmdstanpy - INFO - Chain [1] done processing
17:28:53 - cmdstanpy - INFO - Chain [1] start processing
17:28:54 - cmdstanpy - INFO - Chain [1] done processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] done processing
17:28:55 - cmdstanpy - INFO - Chain [1] done processing
17:28:56 - cmdstanpy - INFO - Chain [1] done processing
17:28:56 - cmdstanpy - INFO - Chain [1] done processing
17:28:56 - cmdstanpy - INFO - Chain [1] start processing
17:28:57 - cmdstanpy - INFO - Chain [1] done processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] done processing
17:28:59 - cmdstanpy - INFO - Chain [1] done processing
17:28:59 - cmdstanpy - INFO - Chain [1] done processing
17:28:59 - cmdstanpy - INFO - Chain [1] done processing
17:28:59 - cmdstanpy - INFO - Chain [1] start processing
17:29:00 - cmdstanpy - INFO - Chain [1] done processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:02 - cmdstanpy - INFO - Chain [1] done processing
17:29:02 - cmdstanpy - INFO - Chain [1] done processing
17:29:02 - cmdstanpy - INFO - Chain [1] done processing
17:29:02 - cmdstanpy - INFO - Chain [1] done processing
17:29:02 - cmdstanpy - INFO - Chain [1] start processing
17:29:03 - cmdstanpy - INFO - Chain [1] done processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:04 - cmdstanpy - INFO - Chain [1] done processing
17:29:05 - cmdstanpy - INFO - Chain [1] done processing
17:29:05 - cmdstanpy - INFO - Chain [1] done processing
17:29:05 - cmdstanpy - INFO - Chain [1] done processing
17:29:06 - cmdstanpy - INFO - Chain [1] start processing
17:29:06 - cmdstanpy - INFO - Chain [1] done processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] start processing
17:29:10 - cmdstanpy - INFO - Chain [1] done processing
17:29:10 - cmdstanpy - INFO - Chain [1] start processing
17:29:11 - cmdstanpy - INFO - Chain [1] start processing
17:29:11 - cmdstanpy - INFO - Chain [1] start processing
17:29:11 - cmdstanpy - INFO - Chain [1] start processing
17:29:11 - cmdstanpy - INFO - Chain [1] done processing
17:29:11 - cmdstanpy - INFO - Chain [1] done processing
17:29:11 - cmdstanpy - INFO - Chain [1] done processing
17:29:12 - cmdstanpy - INFO - Chain [1] done processing
17:29:12 - cmdstanpy - INFO - Chain [1] start processing
17:29:13 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] start processing
17:29:14 - cmdstanpy - INFO - Chain [1] start processing
17:29:14 - cmdstanpy - INFO - Chain [1] start processing
17:29:14 - cmdstanpy - INFO - Chain [1] start processing
17:29:14 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] start processing
17:29:16 - cmdstanpy - INFO - Chain [1] done processing
17:29:16 - cmdstanpy - INFO - Chain [1] start processing
17:29:16 - cmdstanpy - INFO - Chain [1] start processing
17:29:16 - cmdstanpy - INFO - Chain [1] start processing
17:29:16 - cmdstanpy - INFO - Chain [1] start processing
17:29:17 - cmdstanpy - INFO - Chain [1] done processing
17:29:17 - cmdstanpy - INFO - Chain [1] done processing
17:29:18 - cmdstanpy - INFO - Chain [1] done processing
17:29:18 - cmdstanpy - INFO - Chain [1] done processing
17:29:18 - cmdstanpy - INFO - Chain [1] start processing
17:29:19 - cmdstanpy - INFO - Chain [1] done processing
17:29:20 - cmdstanpy - INFO - Chain [1] start processing
17:29:20 - cmdstanpy - INFO - Chain [1] start processing
17:29:20 - cmdstanpy - INFO - Chain [1] start processing
17:29:20 - cmdstanpy - INFO - Chain [1] start processing
17:29:20 - cmdstanpy - INFO - Chain [1] done processing
17:29:20 - cmdstanpy - INFO - Chain [1] done processing
17:29:21 - cmdstanpy - INFO - Chain [1] done processing
17:29:21 - cmdstanpy - INFO - Chain [1] done processing
17:29:21 - cmdstanpy - INFO - Chain [1] start processing
17:29:22 - cmdstanpy - INFO - Chain [1] done processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] done processing
17:29:24 - cmdstanpy - INFO - Chain [1] done processing
17:29:24 - cmdstanpy - INFO - Chain [1] done processing
17:29:24 - cmdstanpy - INFO - Chain [1] done processing
17:29:24 - cmdstanpy - INFO - Chain [1] start processing
17:29:25 - cmdstanpy - INFO - Chain [1] done processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] start processing
17:29:28 - cmdstanpy - INFO - Chain [1] done processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] start processing
17:29:31 - cmdstanpy - INFO - Chain [1] done processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:32 - cmdstanpy - INFO - Chain [1] done processing
17:29:32 - cmdstanpy - INFO - Chain [1] done processing
17:29:33 - cmdstanpy - INFO - Chain [1] done processing
17:29:33 - cmdstanpy - INFO - Chain [1] done processing
17:29:33 - cmdstanpy - INFO - Chain [1] start processing
17:29:35 - cmdstanpy - INFO - Chain [1] done processing
17:29:36 - cmdstanpy - INFO - Chain [1] start processing
17:29:36 - cmdstanpy - INFO - Chain [1] start processing
17:29:36 - cmdstanpy - INFO - Chain [1] start processing
17:29:36 - cmdstanpy - INFO - Chain [1] start processing
17:29:36 - cmdstanpy - INFO - Chain [1] done processing
17:29:36 - cmdstanpy - INFO - Chain [1] done processing
17:29:36 - cmdstanpy - INFO - Chain [1] done processing
17:29:37 - cmdstanpy - INFO - Chain [1] done processing
17:29:37 - cmdstanpy - INFO - Chain [1] start processing
17:29:38 - cmdstanpy - INFO - Chain [1] done processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] done processing
17:29:39 - cmdstanpy - INFO - Chain [1] done processing
17:29:39 - cmdstanpy - INFO - Chain [1] done processing
17:29:39 - cmdstanpy - INFO - Chain [1] done processing
17:29:40 - cmdstanpy - INFO - Chain [1] start processing
17:29:41 - cmdstanpy - INFO - Chain [1] done processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] done processing
17:29:42 - cmdstanpy - INFO - Chain [1] done processing
17:29:42 - cmdstanpy - INFO - Chain [1] done processing
17:29:43 - cmdstanpy - INFO - Chain [1] done processing
17:29:43 - cmdstanpy - INFO - Chain [1] start processing
17:29:44 - cmdstanpy - INFO - Chain [1] done processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] done processing
17:29:45 - cmdstanpy - INFO - Chain [1] done processing
17:29:45 - cmdstanpy - INFO - Chain [1] done processing
17:29:46 - cmdstanpy - INFO - Chain [1] done processing
17:29:46 - cmdstanpy - INFO - Chain [1] start processing
17:29:47 - cmdstanpy - INFO - Chain [1] done processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:49 - cmdstanpy - INFO - Chain [1] done processing
17:29:49 - cmdstanpy - INFO - Chain [1] done processing
17:29:49 - cmdstanpy - INFO - Chain [1] done processing
17:29:49 - cmdstanpy - INFO - Chain [1] done processing
17:29:49 - cmdstanpy - INFO - Chain [1] start processing
17:29:50 - cmdstanpy - INFO - Chain [1] done processing
17:29:51 - cmdstanpy - INFO - Chain [1] start processing
17:29:51 - cmdstanpy - INFO - Chain [1] start processing
17:29:51 - cmdstanpy - INFO - Chain [1] start processing
17:29:51 - cmdstanpy - INFO - Chain [1] start processing
17:29:52 - cmdstanpy - INFO - Chain [1] done processing
17:29:52 - cmdstanpy - INFO - Chain [1] done processing
17:29:52 - cmdstanpy - INFO - Chain [1] done processing
17:29:52 - cmdstanpy - INFO - Chain [1] done processing
17:29:52 - cmdstanpy - INFO - Chain [1] start processing
17:29:53 - cmdstanpy - INFO - Chain [1] done processing
17:29:54 - cmdstanpy - INFO - Chain [1] start processing
17:29:54 - cmdstanpy - INFO - Chain [1] start processing
17:29:54 - cmdstanpy - INFO - Chain [1] start processing
17:29:54 - cmdstanpy - INFO - Chain [1] start processing
17:29:55 - cmdstanpy - INFO - Chain [1] done processing
17:29:55 - cmdstanpy - INFO - Chain [1] done processing
17:29:55 - cmdstanpy - INFO - Chain [1] done processing
17:29:55 - cmdstanpy - INFO - Chain [1] done processing
17:29:55 - cmdstanpy - INFO - Chain [1] start processing
17:29:56 - cmdstanpy - INFO - Chain [1] done processing
17:29:57 - cmdstanpy - INFO - Chain [1] start processing
17:29:57 - cmdstanpy - INFO - Chain [1] start processing
17:29:57 - cmdstanpy - INFO - Chain [1] start processing
17:29:57 - cmdstanpy - INFO - Chain [1] start processing
17:29:57 - cmdstanpy - INFO - Chain [1] done processing
17:29:58 - cmdstanpy - INFO - Chain [1] done processing
17:29:58 - cmdstanpy - INFO - Chain [1] done processing
17:29:58 - cmdstanpy - INFO - Chain [1] done processing
17:29:58 - cmdstanpy - INFO - Chain [1] start processing
17:30:00 - cmdstanpy - INFO - Chain [1] done processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] done processing
17:30:02 - cmdstanpy - INFO - Chain [1] done processing
17:30:02 - cmdstanpy - INFO - Chain [1] done processing
17:30:02 - cmdstanpy - INFO - Chain [1] done processing
17:30:02 - cmdstanpy - INFO - Chain [1] start processing
17:30:03 - cmdstanpy - INFO - Chain [1] done processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:04 - cmdstanpy - INFO - Chain [1] done processing
17:30:05 - cmdstanpy - INFO - Chain [1] done processing
17:30:05 - cmdstanpy - INFO - Chain [1] done processing
17:30:05 - cmdstanpy - INFO - Chain [1] done processing
17:30:05 - cmdstanpy - INFO - Chain [1] start processing
17:30:06 - cmdstanpy - INFO - Chain [1] done processing
17:30:07 - cmdstanpy - INFO - Chain [1] start processing
17:30:07 - cmdstanpy - INFO - Chain [1] start processing
17:30:07 - cmdstanpy - INFO - Chain [1] start processing
17:30:07 - cmdstanpy - INFO - Chain [1] start processing
17:30:07 - cmdstanpy - INFO - Chain [1] done processing
17:30:07 - cmdstanpy - INFO - Chain [1] done processing
17:30:07 - cmdstanpy - INFO - Chain [1] done processing
17:30:08 - cmdstanpy - INFO - Chain [1] done processing
17:30:08 - cmdstanpy - INFO - Chain [1] start processing
17:30:09 - cmdstanpy - INFO - Chain [1] done processing
17:30:10 - cmdstanpy - INFO - Chain [1] start processing
17:30:10 - cmdstanpy - INFO - Chain [1] start processing
17:30:10 - cmdstanpy - INFO - Chain [1] start processing
17:30:10 - cmdstanpy - INFO - Chain [1] start processing
17:30:10 - cmdstanpy - INFO - Chain [1] done processing
17:30:10 - cmdstanpy - INFO - Chain [1] done processing
17:30:11 - cmdstanpy - INFO - Chain [1] done processing
17:30:11 - cmdstanpy - INFO - Chain [1] done processing
17:30:11 - cmdstanpy - INFO - Chain [1] start processing
17:30:13 - cmdstanpy - INFO - Chain [1] done processing
17:30:13 - cmdstanpy - INFO - Chain [1] start processing
17:30:13 - cmdstanpy - INFO - Chain [1] start processing
17:30:13 - cmdstanpy - INFO - Chain [1] start processing
17:30:14 - cmdstanpy - INFO - Chain [1] start processing
17:30:14 - cmdstanpy - INFO - Chain [1] done processing
17:30:14 - cmdstanpy - INFO - Chain [1] done processing
17:30:14 - cmdstanpy - INFO - Chain [1] done processing
17:30:14 - cmdstanpy - INFO - Chain [1] done processing
17:30:14 - cmdstanpy - INFO - Chain [1] start processing
17:30:15 - cmdstanpy - INFO - Chain [1] done processing
17:30:16 - cmdstanpy - INFO - Chain [1] start processing
17:30:16 - cmdstanpy - INFO - Chain [1] start processing
17:30:16 - cmdstanpy - INFO - Chain [1] start processing
17:30:16 - cmdstanpy - INFO - Chain [1] start processing
17:30:17 - cmdstanpy - INFO - Chain [1] done processing
17:30:17 - cmdstanpy - INFO - Chain [1] done processing
17:30:17 - cmdstanpy - INFO - Chain [1] done processing
17:30:17 - cmdstanpy - INFO - Chain [1] done processing
17:30:18 - cmdstanpy - INFO - Chain [1] start processing
17:30:19 - cmdstanpy - INFO - Chain [1] done processing
17:30:19 - cmdstanpy - INFO - Chain [1] start processing
17:30:20 - cmdstanpy - INFO - Chain [1] start processing
17:30:20 - cmdstanpy - INFO - Chain [1] start processing
17:30:20 - cmdstanpy - INFO - Chain [1] start processing
17:30:20 - cmdstanpy - INFO - Chain [1] done processing
17:30:20 - cmdstanpy - INFO - Chain [1] done processing
17:30:20 - cmdstanpy - INFO - Chain [1] done processing
17:30:21 - cmdstanpy - INFO - Chain [1] done processing
17:30:21 - cmdstanpy - INFO - Chain [1] start processing
17:30:22 - cmdstanpy - INFO - Chain [1] done processing
17:30:23 - cmdstanpy - INFO - Chain [1] start processing
17:30:23 - cmdstanpy - INFO - Chain [1] start processing
17:30:23 - cmdstanpy - INFO - Chain [1] start processing
17:30:23 - cmdstanpy - INFO - Chain [1] start processing
17:30:23 - cmdstanpy - INFO - Chain [1] done processing
17:30:24 - cmdstanpy - INFO - Chain [1] done processing
17:30:24 - cmdstanpy - INFO - Chain [1] done processing
17:30:24 - cmdstanpy - INFO - Chain [1] done processing
17:30:24 - cmdstanpy - INFO - Chain [1] start processing
17:30:25 - cmdstanpy - INFO - Chain [1] done processing
17:30:26 - cmdstanpy - INFO - Chain [1] start processing
17:30:26 - cmdstanpy - INFO - Chain [1] start processing
17:30:26 - cmdstanpy - INFO - Chain [1] start processing
17:30:26 - cmdstanpy - INFO - Chain [1] start processing
17:30:26 - cmdstanpy - INFO - Chain [1] done processing
17:30:27 - cmdstanpy - INFO - Chain [1] done processing
17:30:27 - cmdstanpy - INFO - Chain [1] done processing
17:30:27 - cmdstanpy - INFO - Chain [1] done processing
17:30:28 - cmdstanpy - INFO - Chain [1] start processing
17:30:29 - cmdstanpy - INFO - Chain [1] done processing
17:30:29 - cmdstanpy - INFO - Chain [1] start processing
17:30:30 - cmdstanpy - INFO - Chain [1] start processing
17:30:30 - cmdstanpy - INFO - Chain [1] start processing
17:30:30 - cmdstanpy - INFO - Chain [1] start processing
17:30:30 - cmdstanpy - INFO - Chain [1] done processing
17:30:30 - cmdstanpy - INFO - Chain [1] done processing
17:30:30 - cmdstanpy - INFO - Chain [1] done processing
17:30:31 - cmdstanpy - INFO - Chain [1] done processing
17:30:31 - cmdstanpy - INFO - Chain [1] start processing
17:30:32 - cmdstanpy - INFO - Chain [1] done processing
17:30:33 - cmdstanpy - INFO - Chain [1] start processing
17:30:33 - cmdstanpy - INFO - Chain [1] start processing
17:30:33 - cmdstanpy - INFO - Chain [1] start processing
17:30:33 - cmdstanpy - INFO - Chain [1] start processing
17:30:33 - cmdstanpy - INFO - Chain [1] done processing
17:30:33 - cmdstanpy - INFO - Chain [1] done processing
17:30:34 - cmdstanpy - INFO - Chain [1] done processing
17:30:34 - cmdstanpy - INFO - Chain [1] done processing
17:30:34 - cmdstanpy - INFO - Chain [1] start processing
17:30:35 - cmdstanpy - INFO - Chain [1] done processing
17:30:36 - cmdstanpy - INFO - Chain [1] start processing
17:30:36 - cmdstanpy - INFO - Chain [1] start processing
17:30:36 - cmdstanpy - INFO - Chain [1] start processing
17:30:36 - cmdstanpy - INFO - Chain [1] start processing
17:30:36 - cmdstanpy - INFO - Chain [1] done processing
17:30:37 - cmdstanpy - INFO - Chain [1] done processing
17:30:37 - cmdstanpy - INFO - Chain [1] done processing
17:30:37 - cmdstanpy - INFO - Chain [1] done processing
17:30:37 - cmdstanpy - INFO - Chain [1] start processing
17:30:39 - cmdstanpy - INFO - Chain [1] done processing
17:30:39 - cmdstanpy - INFO - Chain [1] start processing
17:30:39 - cmdstanpy - INFO - Chain [1] start processing
17:30:39 - cmdstanpy - INFO - Chain [1] start processing
17:30:39 - cmdstanpy - INFO - Chain [1] start processing
17:30:40 - cmdstanpy - INFO - Chain [1] done processing
17:30:40 - cmdstanpy - INFO - Chain [1] done processing
17:30:40 - cmdstanpy - INFO - Chain [1] done processing
17:30:41 - cmdstanpy - INFO - Chain [1] done processing
17:30:41 - cmdstanpy - INFO - Chain [1] start processing
17:30:42 - cmdstanpy - INFO - Chain [1] done processing
17:30:43 - cmdstanpy - INFO - Chain [1] start processing
17:30:43 - cmdstanpy - INFO - Chain [1] start processing
17:30:43 - cmdstanpy - INFO - Chain [1] start processing
17:30:43 - cmdstanpy - INFO - Chain [1] start processing
17:30:43 - cmdstanpy - INFO - Chain [1] done processing
17:30:43 - cmdstanpy - INFO - Chain [1] done processing
17:30:43 - cmdstanpy - INFO - Chain [1] done processing
17:30:44 - cmdstanpy - INFO - Chain [1] done processing
17:30:44 - cmdstanpy - INFO - Chain [1] start processing
17:30:45 - cmdstanpy - INFO - Chain [1] done processing
17:30:46 - cmdstanpy - INFO - Chain [1] start processing
17:30:46 - cmdstanpy - INFO - Chain [1] start processing
17:30:46 - cmdstanpy - INFO - Chain [1] start processing
17:30:46 - cmdstanpy - INFO - Chain [1] start processing
17:30:46 - cmdstanpy - INFO - Chain [1] done processing
17:30:46 - cmdstanpy - INFO - Chain [1] done processing
17:30:47 - cmdstanpy - INFO - Chain [1] done processing
17:30:47 - cmdstanpy - INFO - Chain [1] done processing
17:30:47 - cmdstanpy - INFO - Chain [1] start processing
17:30:48 - cmdstanpy - INFO - Chain [1] done processing
17:30:49 - cmdstanpy - INFO - Chain [1] start processing
17:30:49 - cmdstanpy - INFO - Chain [1] start processing
17:30:49 - cmdstanpy - INFO - Chain [1] start processing
17:30:49 - cmdstanpy - INFO - Chain [1] start processing
17:30:50 - cmdstanpy - INFO - Chain [1] done processing
17:30:50 - cmdstanpy - INFO - Chain [1] done processing
17:30:50 - cmdstanpy - INFO - Chain [1] done processing
17:30:50 - cmdstanpy - INFO - Chain [1] done processing
17:30:50 - cmdstanpy - INFO - Chain [1] start processing
17:30:52 - cmdstanpy - INFO - Chain [1] done processing
17:30:52 - cmdstanpy - INFO - Chain [1] start processing
17:30:53 - cmdstanpy - INFO - Chain [1] start processing
17:30:53 - cmdstanpy - INFO - Chain [1] start processing
17:30:53 - cmdstanpy - INFO - Chain [1] start processing
17:30:53 - cmdstanpy - INFO - Chain [1] done processing
17:30:53 - cmdstanpy - INFO - Chain [1] done processing
17:30:53 - cmdstanpy - INFO - Chain [1] done processing
17:30:54 - cmdstanpy - INFO - Chain [1] done processing
17:30:54 - cmdstanpy - INFO - Chain [1] start processing
17:30:55 - cmdstanpy - INFO - Chain [1] done processing
17:30:56 - cmdstanpy - INFO - Chain [1] start processing
17:30:56 - cmdstanpy - INFO - Chain [1] start processing
17:30:56 - cmdstanpy - INFO - Chain [1] start processing
17:30:56 - cmdstanpy - INFO - Chain [1] start processing
17:30:56 - cmdstanpy - INFO - Chain [1] done processing
17:30:56 - cmdstanpy - INFO - Chain [1] done processing
17:30:56 - cmdstanpy - INFO - Chain [1] done processing
17:30:57 - cmdstanpy - INFO - Chain [1] done processing
17:30:57 - cmdstanpy - INFO - Chain [1] start processing
17:30:58 - cmdstanpy - INFO - Chain [1] done processing
17:30:59 - cmdstanpy - INFO - Chain [1] start processing
17:30:59 - cmdstanpy - INFO - Chain [1] start processing
17:30:59 - cmdstanpy - INFO - Chain [1] start processing
17:30:59 - cmdstanpy - INFO - Chain [1] start processing
17:30:59 - cmdstanpy - INFO - Chain [1] done processing
17:31:00 - cmdstanpy - INFO - Chain [1] done processing
17:31:00 - cmdstanpy - INFO - Chain [1] done processing
17:31:00 - cmdstanpy - INFO - Chain [1] done processing
17:31:00 - cmdstanpy - INFO - Chain [1] start processing
17:31:01 - cmdstanpy - INFO - Chain [1] done processing
17:31:02 - cmdstanpy - INFO - Chain [1] start processing
17:31:02 - cmdstanpy - INFO - Chain [1] start processing
17:31:02 - cmdstanpy - INFO - Chain [1] start processing
17:31:02 - cmdstanpy - INFO - Chain [1] start processing
17:31:03 - cmdstanpy - INFO - Chain [1] done processing
17:31:03 - cmdstanpy - INFO - Chain [1] done processing
17:31:03 - cmdstanpy - INFO - Chain [1] done processing
17:31:03 - cmdstanpy - INFO - Chain [1] done processing
17:31:03 - cmdstanpy - INFO - Chain [1] start processing
17:31:05 - cmdstanpy - INFO - Chain [1] done processing
17:31:05 - cmdstanpy - INFO - Chain [1] start processing
17:31:06 - cmdstanpy - INFO - Chain [1] start processing
17:31:06 - cmdstanpy - INFO - Chain [1] start processing
17:31:06 - cmdstanpy - INFO - Chain [1] start processing
17:31:06 - cmdstanpy - INFO - Chain [1] done processing
17:31:06 - cmdstanpy - INFO - Chain [1] done processing
17:31:06 - cmdstanpy - INFO - Chain [1] done processing
Best parameters: {'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01}
17:31:07 - cmdstanpy - INFO - Chain [1] done processing
Code
# Refit the model with the best parameters
final_model = Prophet(growth='logistic', **best_params)
final_model.add_country_holidays(country_name='US')
for feature in features:
    final_model.add_regressor(feature)
final_model.fit(train.assign(cap=1, floor=0))

# Predict on the training set
train_forecast = final_model.predict(train)
train_rmse = sqrt(mean_squared_error(train['y'], train_forecast['yhat']))

# Predict on the test set
test_forecast = final_model.predict(test)
test_rmse = sqrt(mean_squared_error(test['y'], test_forecast['yhat']))

print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")
# Retrieve and print the cross-validated RMSE of the best model
best_rmse_index = np.argmin(rmses)
best_rmse = rmses[best_rmse_index]
print(f"Cross-validated RMSE of the best model: {best_rmse}")
17:31:07 - cmdstanpy - INFO - Chain [1] start processing
17:31:08 - cmdstanpy - INFO - Chain [1] done processing
Train RMSE: 0.0063968552187190315
Test RMSE: 0.10680624649090134
Cross-validated RMSE of the best model: 0.011242406258430045

After extensive tuning, the optimal parameters for the Prophet model are:

  • 'changepoint_prior_scale': 0.5
  • 'seasonality_prior_scale': 0.01
  • 'holidays_prior_scale': 0.01
  • seasonality_mode: 'multiplicative'

A 'changepoint_prior_scale' of 0.5 implies maximum flexibility in capturing trend changes, allowing the model to quickly adapt to shifts in the data. Conversely, a 'seasonality_prior_scale' and 'holidays_prior_scale' of 0.01 introduce a high level of regularization. This minimal seasonality and holiday flexibility help prevent the model from overfitting seasonal patterns and holiday effects.

The 'multiplicative' seasonality_mode means that the model interprets seasonal effects as proportional to the time series level, a useful feature for data with varying seasonal amplitude.

Despite these adjustments, the model still exhibited signs of overfitting, as evidenced by the significant disparity between the training and testing RMSEs, and between the training RMSE and cross-validated RMSE. Multiple rounds of tuning were conducted to address this, but the gap persisted. This suggests that the overfitting may be inherent to the dataset’s characteristics or due to other factors not fully mitigated by parameter adjustments.

1.3.4.3 3. Model Performance

After tuning, the best parameters for the best multivariate Prophet model, I found slightly differ from the ones used in my best univariate Prophet model. In this model, the trends are more flexible, the seasonality flexibility is the same, and the holiday parameter has maximum regularization, higher than that of the univariate model. Also, the multivariate model uses multiplicative seasonality as opposed to additive. The increased flexibility in trends makes sense to me as additional regressors can both cause the model to be more flexible and better adapt to the additional variables and non-linear interactions between the primary time series and additional regressors. I infer that the additional regressors may cause interactions between holiday effects and other regressors which require a heightened level of regularization to prevent overfitting. Finally, I think that the multivariate model may perform better with multiplicative seasonality as opposed to the univeriate’s additive seasonality because seasonal effects may be amplified by additional regressors.

The best test RMSE for my multivariate model is 0.10680624649090134 and the cross-validated RMSE is 0.011242406258430045. It appears that there is evidence of overfitting in this model as well as most that I have created as the test RMSE is much higher than the train RMSE. The RMSEs for the multivariate Prophet model are lower than those of the univariate version. I believe this is because of the access to more information with the addition of other regressors. However, I think these additional regressors also contributed to the overfitting that is apparent in the multivariate Prophet model and absent in its univariate counterpart.

Code
# Test and Train RMSE
print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")

# Print the cross-validated RMSE of the best model
best_rmse = min(rmses)
print(f"Cross-validated RMSE of the best model: {best_rmse}")

# Plotting the actual vs predicted values for the training set
plt.figure(figsize=(15, 6))
plt.plot(train['ds'], train['y'], label='Actual')
plt.plot(train_forecast['ds'], train_forecast['yhat'], label='Predicted')
plt.title('Training Set: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Values')
plt.legend()
plt.show()


# Plotting the actual vs predicted values for the test set
plt.figure(figsize=(15, 6))
plt.plot(test['ds'], test['y'], label='Actual')
plt.plot(test_forecast['ds'], test_forecast['yhat'], label='Predicted')
plt.title('Test Set: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Values')
plt.legend()
plt.show()
Train RMSE: 0.0063968552187190315
Test RMSE: 0.10680624649090134
Cross-validated RMSE of the best model: 0.011242406258430045

Code
# Perform cross-validation
df_cv = cross_validation(final_model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate performance metrics
df_p = performance_metrics(df_cv)

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')

df_p
17:31:09 - cmdstanpy - INFO - Chain [1] start processing
17:31:09 - cmdstanpy - INFO - Chain [1] start processing
17:31:09 - cmdstanpy - INFO - Chain [1] start processing
17:31:09 - cmdstanpy - INFO - Chain [1] start processing
17:31:10 - cmdstanpy - INFO - Chain [1] done processing
17:31:10 - cmdstanpy - INFO - Chain [1] done processing
17:31:10 - cmdstanpy - INFO - Chain [1] done processing
Cross-Validation RMSE: 0.01737289454707667
17:31:19 - cmdstanpy - INFO - Chain [1] done processing
horizon mse rmse mae mape mdape smape coverage
0 3 days 0.000002 0.001353 0.001353 0.001468 0.001468 0.001469 1.0
1 5 days 0.000003 0.001773 0.001731 0.001946 0.001946 0.001948 0.5
2 6 days 0.000007 0.002575 0.002539 0.002832 0.002832 0.002836 0.0
3 9 days 0.000013 0.003606 0.003557 0.003893 0.003893 0.003890 0.0
4 10 days 0.000012 0.003441 0.003346 0.003636 0.003636 0.003632 0.5
5 12 days 0.000014 0.003758 0.003605 0.004045 0.004045 0.004054 0.5
6 13 days 0.000011 0.003301 0.002356 0.002725 0.002725 0.002732 0.5
7 16 days 0.000070 0.008388 0.005954 0.006543 0.006543 0.006501 0.5
8 17 days 0.000084 0.009139 0.008496 0.009219 0.009219 0.009184 0.0
9 19 days 0.000039 0.006236 0.006151 0.006825 0.006825 0.006849 0.0
10 20 days 0.000047 0.006850 0.006842 0.007631 0.007631 0.007635 0.0
11 23 days 0.000166 0.012885 0.011765 0.012828 0.012828 0.012730 0.0
12 24 days 0.000165 0.012840 0.011676 0.012639 0.012639 0.012564 0.5
13 26 days 0.000062 0.007870 0.007743 0.008555 0.008555 0.008593 1.0
14 27 days 0.000092 0.009592 0.009582 0.010614 0.010614 0.010613 0.5
15 30 days 0.000340 0.018433 0.017040 0.018513 0.018513 0.018314 0.0
16 31 days 0.000356 0.018874 0.017805 0.019155 0.019155 0.019021 0.5
17 33 days 0.000650 0.025499 0.022853 0.025108 0.025108 0.025516 0.5
18 34 days 0.000710 0.026647 0.025033 0.027602 0.027602 0.027902 0.0
19 37 days 0.000631 0.025115 0.023830 0.025796 0.025796 0.025430 0.0
20 38 days 0.000679 0.026061 0.025230 0.026997 0.026997 0.026799 0.0
21 40 days 0.000816 0.028557 0.027248 0.029646 0.029646 0.030147 0.0
22 41 days 0.000822 0.028667 0.027415 0.030074 0.030074 0.030378 0.0
23 44 days 0.000877 0.029623 0.028176 0.030375 0.030375 0.029872 0.0
24 45 days 0.000938 0.030624 0.029648 0.031597 0.031597 0.031326 0.5

1.3.5 E. XGBoost Model

1.3.5.1 1. Data Preparation:

It is important to initially mention that I decided to develop an XGBoost model for four different versions of my data.

  1. Ungrouped, unscaled data: Essentially, the dataframe created after the initial preprocessing.
  2. Grouped, unscaled data: All observations on a specific day are averaged so that Date is a unique identifier, and the features remain the same magnitude as they were observed.
  3. Grouped, scaled data: All observations on a specific day are averaged so that Date is a unique identifier, and the features are scaled to be between zero and one.
  4. Ungrouped, scaled data: There are multiple observations per Date, and the features are scaled to be between zero and one.

For all of the versions, however, there are a few common preprocessing steps I took. I began by sorting my data by Date and Location to ensure consistency before splitting into train and test sets. I tried creating models with a few different versions of engineered features, and I will include each iteration of my feature engineering and model output process in the appendix; however, for the sake of brevity and clarity, I will include the feature engineering setup I used for my final model I tuned for each data version outlined above. First, I added rolling mean and standard deviation columns to adjust for seasonality and reduce noise (Dancho, 2017). I settled on window = 12 which represents the three-month seasonality pattern I had previously identified. Furthermore, I converted the Date column to a datetime datatype and added additional lag columns for three and nine month lags to account for the three-month pattern. I chose not to impute the missing values of the lag columns as one does not need to for XGBoost I also one-hot-encoded my data to account for the few categorical variables in my dataframe to ensure compatibility with XGBoost. Here is how I did that process for Version 1 of my data:

Code
# Import data
df = pd.read_csv('df_post_eda.csv')

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct' 

# Converting Date column to datetime
df['Date'] = pd.to_datetime(df['Date'])

# Sorting data by Date and Location
df_v1 = df.sort_values(by=['Date', 'Location'])

# Additional time-series features to account for 3-month pattern
# 3 month lag
df_v1['Additional_Doses_Vax_Pct_3_m_lag'] = df_v1['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v1['Additional_Doses_Vax_Pct_9_m_lag'] = df_v1['Additional_Doses_Vax_Pct'].shift(36)

# Rolling statistics
df_v1['rolling_mean'] = df_v1[pred_var].shift().rolling(window=12).mean()
df_v1['rolling_std'] = df_v1[pred_var].shift().rolling(window=12).std()

# One-hot encoding of the entire dataframe
df_encoded_v1 = pd.get_dummies(df_v1)

Version 1

For the train-test split for Version 1 of my data, I first created a list (splits_by_date) where each element is a DataFrame containing all records from df_encoded corresponding to a unique date. This is done by iterating over each unique date in the Date column. I then initialized a TimeSeriesSplit object from Scikit-learn. TimeSeriesSplit is a cross-validator for time series data, providing train/test indices to split time series data samples. I set it to have 5 splits, with a test size of 12, and a gap of 12. The test_size indicates the number of observations to include in each test set, and gap specifies a gap period between the train and test sets to avoid leakage. I finally created the actual train and test splits by running a loop that iterates over the pairs of train and test indices generated by tscv.split(splits_by_date). For each pair of indices, it concatenates the data frames from splits_by_date corresponding to those indices to create the training and testing sets. This way, I ended up with multiple sets of train and test data, respecting the temporal order of the data. Finally, I dropped the Date column after using it to create the splits as XGBoost can only handle numerical data and the Date attribute is represented in several of the engineered features I created previously. The best model that I created for Version 1 of my data performed quite poorly, so I just used all of the features in my dataframe and did not proceed with feature selection for this data version.

Code
# Split the dataset based on unique dates
splits_by_date_v1 = [df_encoded_v1[df_encoded_v1['Date'] == date] for date in df_encoded_v1['Date'].unique()]

# TimeSeriesSplit
# I made the test_size = 12 because I think three months' worth of data is sufficient

tscv = TimeSeriesSplit(n_splits=3, test_size = 12, gap = 12)

# Loop to create train and test splits
for train_index, test_index in tscv.split(splits_by_date_v1):
    train_v1 = pd.concat([splits_by_date_v1[i] for i in train_index])
    test_v1 = pd.concat([splits_by_date_v1[i] for i in test_index])

# Set up XGBoost data structures
X_train_v1, y_train_v1 = train_v1.drop([pred_var, 'Date'], axis=1), train_v1[pred_var]
X_test_v1, y_test_v1 = test_v1.drop([pred_var, 'Date'], axis=1), test_v1[pred_var]

Version 2

For Version 2, I followed the same specifications as Version 1; however, I dropped the Location column as I am averaging the observations for each Date across all locations. I still did not perform feature selection because the model using these data performed similarly as poorly as Version 1’s did. Also, I am including a line to perform that grouping and the feature engineering after grouping.

Code
# Dropping Location column because we are grouping by Location
df_v2 = df.drop('Location', axis = 1)

# Group by 'Date' to ensure there is one unique value per date
df_v2 = df_v2.groupby('Date').mean(numeric_only=True).reset_index()

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_v2['Additional_Doses_Vax_Pct_3_m_lag'] = df_v2['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v2['Additional_Doses_Vax_Pct_9_m_lag'] = df_v2['Additional_Doses_Vax_Pct'].shift(36)

# Rolling statistics
df_v2['rolling_mean'] = df_v2[pred_var].shift().rolling(window=12).mean()
df_v2['rolling_std'] = df_v2[pred_var].shift().rolling(window=12).std()

# One-hot encoding of the entire dataframe
df_v2_encoded = pd.get_dummies(df_v2)

# Split the dataset based on unique dates
splits_by_date_v2 = [df_v2_encoded[df_v2_encoded['Date'] == date] for date in df_v2_encoded['Date'].unique()]

# Train test split
for train_index, test_index in tscv.split(splits_by_date_v2):
    train_v2 = pd.concat([splits_by_date_v2[i] for i in train_index])
    test_v2 = pd.concat([splits_by_date_v2[i] for i in test_index])

# Set up XGBoost data structures and dropping Date column because it cannot be used directly
X_train_v2, y_train_v2 = train_v2.drop([pred_var, 'Date'], axis=1), train_v2[pred_var]
X_test_v2, y_test_v2 = test_v2.drop([pred_var, 'Date'], axis=1), test_v2[pred_var]

Version 3

Version 3 follows the same process as Version 2 with some modifications for scaling. Here, I employed the MinMaxScaler() function to scale the features from 0 to 1. To do this, I had to drop the Date column from the dataframe as it cannot be scaled; however, I added it back to the dataframe after scaling for use in the train-test split. I included feature engineering after grouping and scaling the data. I did not have time to do feature selection here and chose only to do it on Version 4 as it was the version whose model achieved the best results for XGBoost.

Code
# Dropping Location column because we are grouping by Location
df_v3 = df.drop('Location', axis = 1)

# Group by 'Date' to ensure there is one unique value per date
df_v3 = df_v3.groupby('Date').mean(numeric_only=True).reset_index()

# Create a new DataFrame from the aggregated data
data = pd.DataFrame(df_v3)

# Separate the 'Date' column for scaling
date_column = data['Date']
data_without_date = data.drop('Date', axis=1)

# Initialize the MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data without the 'Date' column
scaled_data = min_max_scaler.fit_transform(data_without_date)

# Create a new DataFrame with the scaled data
df_v3 = pd.DataFrame(scaled_data, columns=data_without_date.columns, index=data_without_date.index)

# Add the 'Date' column back to the scaled DataFrame (for train test split)
df_v3['Date'] = date_column

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_v3['Additional_Doses_Vax_Pct_3_m_lag'] = df_v3['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v3['Additional_Doses_Vax_Pct_9_m_lag'] = df_v3['Additional_Doses_Vax_Pct'].shift(36)

# Rolling statistics
df_v3['rolling_mean'] = df_v3[pred_var].shift().rolling(window=12).mean()
df_v3['rolling_std'] = df_v3[pred_var].shift().rolling(window=12).std()

# One-hot encoding of the entire dataframe
df_encoded_v3 = pd.get_dummies(df_v3)

# Split the dataset based on unique dates
splits_by_date_v3 = [df_encoded_v3[df_encoded_v3['Date'] == date] for date in df_encoded_v3['Date'].unique()]

# Train test split
for train_index, test_index in tscv.split(splits_by_date_v3):
    train_v3 = pd.concat([splits_by_date_v3[i] for i in train_index])
    test_v3 = pd.concat([splits_by_date_v3[i] for i in test_index])

# Set up XGBoost data structures and dropping Date column because it cannot be used directly
X_train_v3, y_train_v3 = train_v3.drop([pred_var, 'Date'], axis=1), train_v3[pred_var]
X_test_v3, y_test_v3 = test_v3.drop([pred_var, 'Date'], axis=1), test_v3[pred_var]

Version 4

Version 4’s data preparation consists of a combination of 1’s and 3’s in that I scale the data but do not group it. I performed feature selection after tuning my base model which I will explain more in the tuning section. I again had to drop the Date column and re-append after one hot encoding and scaling the data.

Code
# Save the 'Date' column and drop it from the DataFrame
date_column = df['Date']
df.drop('Date', axis=1, inplace=True)

# Apply one-hot encoding to the DataFrame
df_encoded_v4 = pd.get_dummies(df)

# Apply the scaler to the encoded data
df_v4 = pd.DataFrame(min_max_scaler.fit_transform(df_encoded_v4), columns=df_encoded_v4.columns)

# Re-attach the 'Date' column
df_v4['Date'] = date_column

# Reorder the columns to place 'Date' at the start
df_v4 = df_v4[['Date'] + [col for col in df_v4.columns if col != 'Date']]

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_v4['Additional_Doses_Vax_Pct_3_m_lag'] = df_v4['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v4['Additional_Doses_Vax_Pct_9_m_lag'] = df_v4['Additional_Doses_Vax_Pct'].shift(36)

# 1 week lag (because ACF plot said to)
df_v4['Additional_Doses_Vax_Pct_1_w_lag'] = df_v4['Additional_Doses_Vax_Pct'].shift(1)

# Rolling statistics
df_v4['rolling_mean'] = df_v4[pred_var].shift().rolling(window=12).mean()
df_v4['rolling_std'] = df_v4[pred_var].shift().rolling(window=12).std()

# Split the dataset based on unique dates
splits_by_date_v4 = [df_v4[df_v4['Date'] == date] for date in df_v4['Date'].unique()]

# Train test split
for train_index, test_index in tscv.split(splits_by_date_v4):
    train_v4 = pd.concat([splits_by_date_v4[i] for i in train_index])
    test_v4 = pd.concat([splits_by_date_v4[i] for i in test_index])
    
# Set up XGBoost data structures and dropping 'Date' because XGBoost cannot handle it
X_train_v4, y_train_v4 = train_v4.drop([pred_var, 'Date'], axis=1), train_v4[pred_var]
X_test_v4, y_test_v4 = test_v4.drop([pred_var, 'Date'], axis=1), test_v4[pred_var]

1.3.5.2 2. Model Building:

XGBoost, which stands for eXtreme Gradient Boosting, works by iteratively combining a sequence of simple decision trees, each correcting the errors of its predecessors, to form a powerful ensemble model that delivers highly accurate predictions. In the context of predicting vaccine rates, XGBoost stands out for its ability to handle complex, varied datasets with high efficiency and accuracy. It is robust to different data types and missing values and it has powerful boosting capabilities. However, successful application requires thoughtful preprocessing, feature engineering, and hyperparameter optimization to tailor the model to the specific nuances of vaccine data. Furthermore, XGBoost models do not have an inherent understanding of temporal structures of time series data (Brownlee, 2021; Jain, 2023).

XGBoost has a variety of parameters to tune. I will briefly go over some of the key ones I decided to tune and focus on.

subsample controls the proportion of data used to create each tree.

reg_alpha represents the L1 regularization term on weights (Lasso Regression) used to prevent overfitting by penalizing the absolute size of the weights; a larger value specifies stronger regularization, and it can drive some weights to zero.

reg_lambda represents the L2 regularization term on weights (Ridge Regression) used to prevent overfitting by penalizing large weights; a larger value specifies stronger regularization.

n_estimators is the number of gradient boosted trees to be used in the model with a higher number giving potentially more predictive power but also slower run times and overfitting.

min_child_weight specifies the minimum sum of instance weight needed in a leaf to control overfitting. High values help the model avoid learning highly specific relations for a selected tree sample.

max_depth denotes the maximum tree depth with a deeper tree corresponding with more complex, potentially overfit, relationships by allowing for more splits.

learning_rate scales each tree’s contribution. Higher values can cause models to be bad at generalizing whereas smaller values can make models robust but time consuming to train.

gamma controls the minimum loss reduction required to make a further separation on a leaf node with a higher value corresponding with fewer splits.

colsample_bytree represents the proportion of features to be randomly sampled to create each tree. Randomness helps with model robustness and prevents overfitting (xgboost developers, 2022).

As for the training process for XGBoost, I followed the same process for each version; however, I will show how I trained the model for Version 4 below and the training process for the other versions will be in the appendix.

In the Data Preparation section, I showed how I split my data into train and test sets and then into X_train, y_train, X_test, and y_test so that the XGBoost model can train on known data and then validate the model’s predictive accuracy on unseen data to ensure its generalizability and effectiveness.

To train a base XGBoost model, I initiated with the parameters learning_rate = 0.01, n_estimators = 1000, and set early_stopping_rounds = 10. I chose a lower learning rate of 0.01, aiming for gradual weight updates to reduce overfitting risks and enhance robustness. I also selected a high number of estimators at 1000 trees to enable the model to capture complex patterns in the time-series dataset. Lastly, I implemented early stopping to halt training after 10 consecutive rounds without improvement in model performance, thereby preventing overfitting and conserving computational resources.

Code
# Initialize the XGBRegressor with specific parameters
reg_base_v4 = XGBRegressor(n_estimators=1000, learning_rate=0.01, early_stopping_rounds=10)

# Fit the model to the training data
reg_base_v4.fit(X_train_v4, y_train_v4, eval_set=[(X_train_v4, y_train_v4), (X_test_v4, y_test_v4)], verbose = False)
XGBRegressor(base_score=None, booster=None, callbacks=None,
             colsample_bylevel=None, colsample_bynode=None,
             colsample_bytree=None, early_stopping_rounds=10,
             enable_categorical=False, eval_metric=None, feature_types=None,
             gamma=None, gpu_id=None, grow_policy=None, importance_type=None,
             interaction_constraints=None, learning_rate=0.01, max_bin=None,
             max_cat_threshold=None, max_cat_to_onehot=None,
             max_delta_step=None, max_depth=None, max_leaves=None,
             min_child_weight=None, missing=nan, monotone_constraints=None,
             n_estimators=1000, n_jobs=None, num_parallel_tree=None,
             predictor=None, random_state=None, ...)
In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.

I then plotted the results of my model and the train and test RMSEs to evaluate the performance of my model and indicate whether I should continue training it.

Code
# Forecasting and Evaluation
train_pred_base_v4 = reg_base_v4.predict(X_train_v4)
test_pred_base_v4 = reg_base_v4.predict(X_test_v4)

# Plotting
fig, ax = plt.subplots(2, 1, figsize=(20, 10))

# Train plot
ax[0].plot(train_v4.index, y_train_v4, label='Actual')
ax[0].plot(train_v4.index, train_pred_base_v4, label='Predicted')
ax[0].set_title('Train Data')
ax[0].legend()

# Test plot
ax[1].plot(test_v4.index, y_test_v4, label='Actual')
ax[1].plot(test_v4.index, test_pred_base_v4, label='Predicted')
ax[1].set_title('Test Data')
ax[1].legend()

# Show the plots
plt.show()

# Print RMSE values
train_rmse_base_v4 = np.sqrt(mean_squared_error(y_train_v4, train_pred_base_v4))
test_rmse_base_v4 = np.sqrt(mean_squared_error(y_test_v4, test_pred_base_v4))
print(f"Train RMSE of base model {train_rmse_base_v4}")
print(f"Test RMSE of base model {test_rmse_base_v4}")

Train RMSE of base model 0.0013047871873905932
Test RMSE of base model 0.090238365990643

These results are good compared to the initial data versions I used. However, I attempt to improve them with feature selection. I did this by extracting feature importances from the previous base XGBoost model, reg_base_v4, by selecting features exceeding the average importance. I then retrained a new model with these selected features, evaluated its performance using RMSE, and printed the number, names of the selected features, and parameters of the retrained model, selected_model_base (Pedregosa et al., 2011).

Code
# 1. Extract feature importances
importances = reg_base_v4.feature_importances_

# 2. Determine a threshold
threshold = np.mean(importances)

# 3. Select features based on threshold
selection = SelectFromModel(reg_base_v4, threshold=threshold, prefit=True)
X_train_selected_v4 = selection.transform(X_train_v4)
X_test_selected_v4 = selection.transform(X_test_v4)

4. # Retrain model with selected features
selected_model_base = xgb.XGBRegressor(learning_rate=0.01, n_estimators=1000, early_stopping_rounds=10)
selected_model_base.fit(X_train_selected_v4, y_train_v4, eval_set=[(X_train_selected_v4, y_train_v4), (X_test_selected_v4, y_test_v4)], verbose=False)

# 5. Evaluate the retrained model
train_pred_selected = selected_model_base.predict(X_train_selected_v4)
test_pred_selected = selected_model_base.predict(X_test_selected_v4)

# Calculate RMSE for the retrained model
train_rmse_selected = np.sqrt(mean_squared_error(y_train_v4, train_pred_selected))
test_rmse_selected = np.sqrt(mean_squared_error(y_test_v4, test_pred_selected))
print(f"Train RMSE with selected features: {train_rmse_selected}")
print(f"Test RMSE with selected features: {test_rmse_selected}")

# Print the number and names of selected features
selected_features = np.array(X_train_v4.columns)[selection.get_support()]
print(f"Number of selected features: {len(selected_features)}")
print("Selected features:", selected_features)

# Print the parameters used in the selected_model_base
params_selected_model_base = selected_model_base.get_params()
print("Parameters used in the model:\n", params_selected_model_base)
Train RMSE with selected features: 0.0012672636322900329
Test RMSE with selected features: 0.08596906481390161
Number of selected features: 12
Selected features: ['Distributed' 'Distributed_Janssen' 'Distributed_Per_100k_65Plus'
 'Administered' 'Administered_Janssen' 'Administered_Pfizer'
 'Administered_Dose1_Recip_65PlusPop_Pct' 'Series_Complete_Janssen'
 'Series_Complete_Unk_Manuf' 'Series_Complete_Unk_Manuf_12Plus'
 'Additional_Doses_18Plus_Vax_Pct' 'Additional_Doses_65Plus_Vax_Pct']
Parameters used in the model:
 {'objective': 'reg:squarederror', 'base_score': None, 'booster': None, 'callbacks': None, 'colsample_bylevel': None, 'colsample_bynode': None, 'colsample_bytree': None, 'early_stopping_rounds': 10, 'enable_categorical': False, 'eval_metric': None, 'feature_types': None, 'gamma': None, 'gpu_id': None, 'grow_policy': None, 'importance_type': None, 'interaction_constraints': None, 'learning_rate': 0.01, 'max_bin': None, 'max_cat_threshold': None, 'max_cat_to_onehot': None, 'max_delta_step': None, 'max_depth': None, 'max_leaves': None, 'min_child_weight': None, 'missing': nan, 'monotone_constraints': None, 'n_estimators': 1000, 'n_jobs': None, 'num_parallel_tree': None, 'predictor': None, 'random_state': None, 'reg_alpha': None, 'reg_lambda': None, 'sampling_method': None, 'scale_pos_weight': None, 'subsample': None, 'tree_method': None, 'validate_parameters': None, 'verbosity': None}

The results showed improvement, but to further enhance the model, I initiated hyperparameter tuning using RandomizedSearchCV for a coarse grid search, which efficiently identifies the general range of optimal hyperparameters with minimal computing resources. RandomizedSearchCV randomly selects and evaluates a specified number of combinations from a given hyperparameter space, using cross-validation to identify the best performing model configuration efficiently. I used cv = tscv to ensure I am cross validating while respecting the temporal nature of the data as TimeSeriesSplit provides train/test indices to split the time series data samples into such a way (Pedregosa et al., 2011).

Code
# Define the hyperparameter space
param_dist_v4 = {
    'learning_rate': [0.001, 0.01, 0.05, 0.1, 0.2, 0.3],
    'n_estimators': [25, 50, 100, 150, 200, 250, 300, 400, 500, 1000],
    'max_depth': np.arange(3, 10, 1),
    'min_child_weight': np.arange(1, 6, 1),
    'gamma': np.linspace(0, 0.5, 5),
    'subsample': np.linspace(0.5, 1, 5),
    'colsample_bytree': np.linspace(0.5, 1, 5),
    'reg_alpha': np.logspace(-5, 1, 5),
    'reg_lambda': np.logspace(-5, 1, 5)
}

# Initialize XGBoost regressor
xgb_reg_v4 = XGBRegressor(n_estimators=1000)

# Initialize RandomizedSearchCV
random_search_v4 = RandomizedSearchCV(
    estimator=xgb_reg_v4, 
    param_distributions=param_dist_v4, 
    n_iter=100, 
    scoring='neg_mean_squared_error', 
    cv=tscv, 
    verbose=1, 
    n_jobs=-1, 
    random_state=42
)

# Perform the tuning
random_search_v4.fit(X_train_selected_v4, y_train_v4)
 
# Evaluate the best model
best_model_fs_v4 = random_search_v4.best_estimator_
train_pred_fs_v4 = best_model_fs_v4.predict(X_train_selected_v4)
test_pred_fs_v4 = best_model_fs_v4.predict(X_test_selected_v4)

# Calculate RMSE for the best model
train_rmse_fs_v4 = sqrt(mean_squared_error(y_train_v4, train_pred_fs_v4))
test_rmse_fs_v4 = sqrt(mean_squared_error(y_test_v4, test_pred_fs_v4))

# Print the best parameters and RMSE values
print("Best parameters:", random_search_v4.best_params_)
print(f"Train RMSE: {train_rmse_fs_v4}")
print(f"Test RMSE: {test_rmse_fs_v4}")
Fitting 3 folds for each of 100 candidates, totalling 300 fits
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
Best parameters: {'subsample': 0.75, 'reg_lambda': 0.31622776601683794, 'reg_alpha': 0.01, 'n_estimators': 400, 'min_child_weight': 1, 'max_depth': 5, 'learning_rate': 0.2, 'gamma': 0.0, 'colsample_bytree': 0.625}
Train RMSE: 0.0011601848782626465
Test RMSE: 0.1025870952741192

Despite searching through other parameters using RandomizedSearchCV, I could not achieve a test RMSE lower than that of the base model with feature selection. Although I wanted to do a GridSearchCV, Professor Shi said not to focus on tuning, and it is very computationally expensive to perform one. Therefore, I proceeded with the parameters found in the feature selected base model.

During this phase, I encountered several challenges: My laptop’s limited memory meant that both RandomizedSearchCV and GridSearchCV were computationally intensive, sometimes taking over 24 hours to complete. Additionally, developing and tuning models for all of the data versions I previously mentioned was time-consuming and often unproductive. Surprisingly, in some cases, my initial base model outperformed the grid-searched models, even though the grid included the base model’s parameters. Finally, I suspect overfitting was a primary issue, likely due to the cumulative nature of my data and the small size of my dataframe.

1.3.5.3 3. Model Performance

I am confident I created and tuned the XGBoost model with among the lowest RMSEs possible given my small dataframe and issues with cumulative predictions. Despite this, compared to other models, the RMSE is relatively high. Furthermore, the visualizations make clear that there is evidence of overfitting in my models. Some of the most important features in this model include the percent of people 18+ who completed a primary series and have received a booster (or additional) doses (Additional_Doses_18Plus_Vax_Pct), total number of doses delivered per 100,000 people ages 65+ (Distributed_Per_100k_65Plus), and total number of doses delivered from other manufacturers (Series_Complete_Unk_Manuf). This indicates that looking at specific age groups’ vaccination rates can help to inform overall vaccination rates and that unpopular vaccine manufacturers might have a large impact.

Code
# Evaluate the retrained model
train_pred_selected = selected_model_base.predict(X_train_selected_v4)
test_pred_selected = selected_model_base.predict(X_test_selected_v4)

# Calculate RMSE for the retrained model
train_rmse_selected = np.sqrt(mean_squared_error(y_train_v4, train_pred_selected))
test_rmse_selected = np.sqrt(mean_squared_error(y_test_v4, test_pred_selected))
print(f"Train RMSE with selected features: {train_rmse_selected}")
print(f"Test RMSE with selected features: {test_rmse_selected}")

# Visualizing Predicted vs Actual Values for Train and Test Sets
fig, ax = plt.subplots(2, 1, figsize=(12, 10))

# Train Data
ax[0].plot(train_v4['Date'], y_train_v4, label='Actual', color='blue')
ax[0].plot(train_v4['Date'], train_pred_selected, label='Predicted', color='red')
ax[0].set_title('Train Data: Actual vs Predicted')
ax[0].legend()
ax[0].set_xlabel('Date')
ax[0].set_ylabel(pred_var)

# Test Data
ax[1].plot(test_v4['Date'], y_test_v4, label='Actual', color='blue')
ax[1].plot(test_v4['Date'], test_pred_selected, label='Predicted', color='red')
ax[1].set_title('Test Data: Actual vs Predicted')
ax[1].legend()
ax[1].set_xlabel('Date')
ax[1].set_ylabel(pred_var)

plt.tight_layout()
plt.show()
# Extract the names of the selected features
selected_feature_names = np.array(X_train_v4.columns)[selection.get_support()]

# Set the feature names in the XGBoost model
selected_model_base.get_booster().feature_names = selected_feature_names.tolist()
# Display Top 5 Important Features
plt.figure(figsize=(10, 6))
plot_importance(selected_model_base, max_num_features=5)
plt.title('Top 5 Important Features')
plt.show()
Train RMSE with selected features: 0.0012672636322900329
Test RMSE with selected features: 0.08596906481390161

<Figure size 1000x600 with 0 Axes>

Code
# Initialize a list to store RMSEs for each fold
cv_rmses = []

# Perform TimeSeriesSplit
for train_index, test_index in tscv.split(splits_by_date_v4):
    train = pd.concat([splits_by_date_v4[i] for i in train_index])
    test = pd.concat([splits_by_date_v4[i] for i in test_index])
    
    X_train, y_train = train.drop([pred_var, 'Date'], axis=1), train[pred_var]
    X_test, y_test = test.drop([pred_var, 'Date'], axis=1), test[pred_var]

    # Feature selection and model fitting as before
    reg_base = XGBRegressor(n_estimators=1000, learning_rate=0.01, early_stopping_rounds=10)
    reg_base.fit(X_train, y_train, eval_set=[(X_train, y_train), (X_test, y_test)], verbose=False)
    selection = SelectFromModel(reg_base, threshold='mean', prefit=True)
    X_train_selected = selection.transform(X_train)
    X_test_selected = selection.transform(X_test)

    selected_model = xgb.XGBRegressor(learning_rate=0.01, n_estimators=1000, early_stopping_rounds=10)
    selected_model.fit(X_train_selected, y_train, eval_set=[(X_train_selected, y_train), (X_test_selected, y_test)], verbose=False)

    # Make predictions and calculate RMSE
    test_pred = selected_model.predict(X_test_selected)
    rmse = np.sqrt(mean_squared_error(y_test, test_pred))
    cv_rmses.append(rmse)

# Calculate the average cross-validated RMSE
cv_rmse = np.mean(cv_rmses)
print(f"Cross-validated RMSE: {cv_rmse}")
Cross-validated RMSE: 0.06388431417642502

1.3.6 F. Long Short-Term Memory (LSTM) Model

1.3.6.1 1. Data Preparation:

For the LSTM model, I created many different initial variations with different data preparations. For instance, I tried some models where I imputed NaN values with zeroes or normalized instead of scaling my data. I will include these versions in the appendix. Below is the data preparation I did for my most successful model.

I began by importing the cleaned data, converting the Date column to a datetime datatype and sorting it by Date and Location to ensure the train-test split is done correctly and without data leakage. I one-hot-encoded the categorical variables as LSTM models inherently work with numerical data, and categorical data are not interpretable by them (Pramoditha, 2022). I then set Date and Location as a multi-index to form a combined, two-level index for each row. This helps to preserve the temporal and spatial context of the dataset to accurately model time series data that varies over time and across different locations. I added the lag and rolling mean and standard deviation models I have added to all of the other models I have developed for the same reasons. There were many NaN values in these columns because of the nature of how lag columns are developed. Finally, I scaled the data to fall within a range from 0 to 1 using MinMaxScaler as LSTM models, like many neural network architectures, are sensitive to the scale of input data. Scaling can optimize gradient descent efficiency and help the data conform to activation function dynamics (Hedengren, 2022).

Next, to create sequences from the scale as inputs to the LSTM model, I created a function make_series so that the model can capture temporal dependencies (Aggarwal, 2023). I wanted to create a sequence for each location to capture any differences in the data across locations, so I grouped using groupby(level = 'Location') before constructing the sequences of length 12 corresponding to a segment of continuous observations. I chose this length to capture the relevant three-month temporal patterns in the data. The target variable, target, for each sequence is pred_var at the end of the sequence. Furthermore, I decided to use all of the features in my model as

The generated sequences, data_series are then split into training and testing sets with the test_size parameter determining the number of sequences included in the test set. I then split data_series into train and test series with the test series being size 1080 as it represents approximately 20% of the data and is a multiple of 12 (the sequence length I used). Finally, the sequences are converted into arrays with X_train and X_test containing the input features (excluding the target variable), and y_train and y_test containing the corresponding target values. Instead of feature selection, I performed feature extraction for this model by employing principal component analysis (PCA) to reduce dimensionality to reduce model complexity. Despite this, I achieved far worse results by way of RMSE. The code I used a results from PCA can be found in the LSTM Feature Extraction section of the appendix.

Finally, I initialized TimeSeriesSplit for cross-validation throughout the model training process to ensure that validation sets are always later in time than the training sets. This respect of temporal order of observations is crucial for time series models such as LSTMs, and it was important for me to cross-validate as I trained my models to mitigate overfitting concerns.

Code
# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location'
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Additional time-series columns to account for 3-month pattern
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

# Forward fill missing values
df_encoded.fillna(method='ffill', inplace=True)
df_encoded.fillna(method='bfill', inplace=True)

# Initialize MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_scaled = pd.DataFrame(min_max_scaler.fit_transform(df_encoded), columns=df_encoded.columns, index=df_encoded.index)

# Function to create sequences for LSTM
def make_series(data, sequence_length, pred_var):
    series = []
    for location, group in data.groupby(level='Location'):
        group = group.reset_index(level='Location', drop=True)
        for i in range(sequence_length, len(group)):
            sequence = group[i - sequence_length:i]
            target = group.iloc[i][pred_var]
            series.append((sequence.index[0], target, sequence.drop(pred_var, axis=1).values))
    return series

# Set sequence length
sequence_length = 12

# Create sequences from the scaled data
data_series = make_series(df_scaled, sequence_length, pred_var)

# Split into train and test sequences
test_size = 1080  # Size of test set
train_series = data_series[:-test_size]
test_series = data_series[-test_size:]

# Prepare data for LSTM
X_train = np.array([x[2] for x in train_series])
y_train = np.array([x[1] for x in train_series])
X_test = np.array([x[2] for x in test_series])
y_test = np.array([x[1] for x in test_series])

# Initialize TimeSeriesSplit
tscv = TimeSeriesSplit(n_splits=5)

1.3.6.2 2. Model Building:

There are many parameters in the LSTM model one can modify to help tune the model. I will go over a few below:

Number of Neurons (neurons_options): In the LSTM layer, units specify the dimensionality of the output space, or the number of neurons in the layer. This parameter determines the model’s ability to learn complex patterns at the risk of overfitting.

Return Sequences (return_sequences): Determines if the layer should return the full sequence (True) or only the last output (False).

Optimizer (optimizer): In the model’s compile method, the optimizer parameter is set, often to ‘adam’ for LSTM models. It’s defined as optimizer='adam'. Adam modifies the learning rate throughout model training.

Loss Function (loss): This computes the quantity that a model should seek to minimize during training, for example Mean Absolute Error (MAE).

Dropout (dropout_options): Dropout is the proportion of the neurons in the layer to be omitted during training and is a regularization technique to prevent overfitting.

Regularization Coefficients (l1_reg_options and l2_reg_options): These are the options for Lasso and Ridge regularization coefficients, respectively used to prevent overfitting.

Batch Size (batch_sizes): Specifies the size of the batch of training data used in each iteration of the model’s training process, influencing the speed and stability of the network’s convergence.

Activation Function (activation): The activation function is a mathematical operation applied to a node’s output, transforming the input signal into an output signal and introducing non-linearity into the model (Chollet, n.d.; Chowdhury, 2021).

As for the training process, in the following code chunk I implement a cross-validation process to train the model followed by training a final model on the full training dataset. I did this by iterating over training and validation splits produced by TimeSeriesSplitand splitting the training data into training and validation sets for the current fold using indices. I then define the LSTM model with an input layer (Input), an LSTM layer (LSTM), a dropout layer (Dropout), and an output layer (Dense). The model is compiled with the Adam optimizer and MAE loss function, trained on the current training fold, and then validated on the respective subset. I decided to use epochs=100 and batch_size=32 because such a relatively high number of epochs allows it to train for an extended period and a batch size of 32 balances computational efficiency and model convergence. After this cross-validation is performed, the final model is defined with the same architecture and trained in the same way on the entire training dataset without validation data to optimize the model’s performance.

Code
# Cross-Validation Loop
for train_index, val_index in tscv.split(X_train):
    X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
    y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

    # Define LSTM model
    inputs = Input(shape=(sequence_length, X_train_fold.shape[2]))
    lstm_out = LSTM(32, return_sequences=False)(inputs)
    lstm_out = Dropout(0.2)(lstm_out)
    outputs = Dense(1)(lstm_out)
    model = Model(inputs=inputs, outputs=outputs)
    model.compile(optimizer='adam', loss='mae')

    # Fit the model on this fold
    model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=32,
              validation_data=(X_val_fold, y_val_fold), shuffle=False)

# Final Model Training on Full Train Data
model_final = Model(inputs=inputs, outputs=outputs)
model_final.compile(optimizer='adam', loss='mae')
model_final.fit(X_train, y_train, epochs=100, batch_size=32, shuffle=False)
Epoch 1/100
2023-11-26 16:26:50.329450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:50.329859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:50.330343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:26:50.409685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:50.410208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:50.410597: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:26:50.574137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:50.574615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:50.575139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 11ms/step - loss: 0.3279 - val_loss: 0.1255
Epoch 2/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1852 - val_loss: 0.1281
Epoch 3/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1596 - val_loss: 0.0841
Epoch 4/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1366
2023-11-26 16:26:50.931643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:50.932156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:50.932522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 3ms/step - loss: 0.1352 - val_loss: 0.1037
Epoch 5/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1185 - val_loss: 0.0801
Epoch 6/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0995 - val_loss: 0.0766
Epoch 7/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0930 - val_loss: 0.0757
Epoch 8/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0876 - val_loss: 0.0682
Epoch 9/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0846 - val_loss: 0.0599
Epoch 10/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0907 - val_loss: 0.0576
Epoch 11/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0880 - val_loss: 0.0943
Epoch 12/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0922 - val_loss: 0.1910
Epoch 13/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1380 - val_loss: 0.0700
Epoch 14/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0844 - val_loss: 0.0735
Epoch 15/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0793 - val_loss: 0.0630
Epoch 16/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0731 - val_loss: 0.0590
Epoch 17/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0531
Epoch 18/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0912
Epoch 19/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0728 - val_loss: 0.0717
Epoch 20/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0709 - val_loss: 0.0802
Epoch 21/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0760
Epoch 22/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0787
Epoch 23/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0691
Epoch 24/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0622
Epoch 25/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0910
Epoch 26/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0809
Epoch 27/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0788
Epoch 28/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0661
Epoch 29/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0660
Epoch 30/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.1006
Epoch 31/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0774
Epoch 32/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0620
Epoch 33/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0611
Epoch 34/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0668 - val_loss: 0.0707
Epoch 35/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0774
Epoch 36/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0870
Epoch 37/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0737 - val_loss: 0.0667
Epoch 38/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0604
Epoch 39/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0597
Epoch 40/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.1150
Epoch 41/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0878
Epoch 42/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0852
Epoch 43/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0838
Epoch 44/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0655
Epoch 45/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0750
Epoch 46/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0683
Epoch 47/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0620
Epoch 48/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0601
Epoch 49/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0578
Epoch 50/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0538
Epoch 51/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0558
Epoch 52/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0601
Epoch 53/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0565
Epoch 54/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0630
Epoch 55/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0582
Epoch 56/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0502
Epoch 57/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0644
Epoch 58/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0940
Epoch 59/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0593
Epoch 60/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0585
Epoch 61/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0987
Epoch 62/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.1171
Epoch 63/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0604 - val_loss: 0.1029
Epoch 64/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0835
Epoch 65/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0656
Epoch 66/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0732 - val_loss: 0.0757
Epoch 67/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0659
Epoch 68/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0686
Epoch 69/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0634
Epoch 70/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0552
Epoch 71/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0536
Epoch 72/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0634
Epoch 73/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0556
Epoch 74/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0458 - val_loss: 0.0516
Epoch 75/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0601
Epoch 76/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0540
Epoch 77/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0488
Epoch 78/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0575
Epoch 79/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0634
Epoch 80/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0585
Epoch 81/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0718
Epoch 82/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0712
Epoch 83/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0458 - val_loss: 0.0741
Epoch 84/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0583
Epoch 85/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0559
Epoch 86/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0573
Epoch 87/100
18/18 [==============================] - 0s 2ms/step - loss: 0.0503 - val_loss: 0.0564
Epoch 88/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0649
Epoch 89/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0574
Epoch 90/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0539
Epoch 91/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0509
Epoch 92/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0564
Epoch 93/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0782
Epoch 94/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0799
Epoch 95/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0818
Epoch 96/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0777
Epoch 97/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0564
Epoch 98/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0571
Epoch 99/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0570
Epoch 100/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0531
Epoch 1/100
2023-11-26 16:26:55.796427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:55.797121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:55.797458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:26:55.875520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:55.875990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:55.876405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
 1/34 [..............................] - ETA: 12s - loss: 0.3191
2023-11-26 16:26:56.004600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:56.005229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:56.005685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 6ms/step - loss: 0.2091 - val_loss: 0.1021
Epoch 2/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1634 - val_loss: 0.1573
Epoch 3/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1176 - val_loss: 0.0896
Epoch 4/100
 1/34 [..............................] - ETA: 0s - loss: 0.0681
2023-11-26 16:26:56.319999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:26:56.320718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:26:56.321218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 2ms/step - loss: 0.1047 - val_loss: 0.0781
Epoch 5/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0920 - val_loss: 0.0646
Epoch 6/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0867 - val_loss: 0.0612
Epoch 7/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0852 - val_loss: 0.0575
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0824 - val_loss: 0.0575
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0805 - val_loss: 0.0640
Epoch 10/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0796 - val_loss: 0.0809
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0708 - val_loss: 0.0617
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0687 - val_loss: 0.0771
Epoch 13/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0685 - val_loss: 0.0913
Epoch 14/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0643 - val_loss: 0.0714
Epoch 15/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0621 - val_loss: 0.0913
Epoch 16/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0668 - val_loss: 0.0589
Epoch 17/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0639 - val_loss: 0.0484
Epoch 18/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0691 - val_loss: 0.0549
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0621 - val_loss: 0.0673
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0581 - val_loss: 0.0720
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0567 - val_loss: 0.0708
Epoch 22/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0541 - val_loss: 0.0826
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0551 - val_loss: 0.0545
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0562 - val_loss: 0.0575
Epoch 25/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0538 - val_loss: 0.0593
Epoch 26/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0539 - val_loss: 0.0549
Epoch 27/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0537 - val_loss: 0.0540
Epoch 28/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0611 - val_loss: 0.0383
Epoch 29/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0601 - val_loss: 0.0610
Epoch 30/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0552 - val_loss: 0.0673
Epoch 31/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0561 - val_loss: 0.0801
Epoch 32/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0527 - val_loss: 0.0636
Epoch 33/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0558 - val_loss: 0.0615
Epoch 34/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0494 - val_loss: 0.0674
Epoch 35/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0511 - val_loss: 0.0851
Epoch 36/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0534 - val_loss: 0.0462
Epoch 37/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0581 - val_loss: 0.0429
Epoch 38/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0565 - val_loss: 0.0534
Epoch 39/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0502 - val_loss: 0.0666
Epoch 40/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0484 - val_loss: 0.0546
Epoch 41/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0479 - val_loss: 0.0501
Epoch 42/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0440 - val_loss: 0.0575
Epoch 43/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0469 - val_loss: 0.0595
Epoch 44/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0477 - val_loss: 0.0534
Epoch 45/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0437 - val_loss: 0.0541
Epoch 46/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0430 - val_loss: 0.0642
Epoch 47/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0470 - val_loss: 0.0567
Epoch 48/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0493 - val_loss: 0.0448
Epoch 49/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0438 - val_loss: 0.0675
Epoch 50/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0435 - val_loss: 0.0619
Epoch 51/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0421 - val_loss: 0.0632
Epoch 52/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0445 - val_loss: 0.0693
Epoch 53/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0431 - val_loss: 0.0462
Epoch 54/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0433 - val_loss: 0.0490
Epoch 55/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0445 - val_loss: 0.0525
Epoch 56/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0404 - val_loss: 0.0472
Epoch 57/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0431 - val_loss: 0.0533
Epoch 58/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0403 - val_loss: 0.0572
Epoch 59/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0417 - val_loss: 0.0491
Epoch 60/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0388 - val_loss: 0.0482
Epoch 61/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0394 - val_loss: 0.0474
Epoch 62/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0411 - val_loss: 0.0569
Epoch 63/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0402 - val_loss: 0.0498
Epoch 64/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0388 - val_loss: 0.0561
Epoch 65/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0369 - val_loss: 0.0499
Epoch 66/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0385 - val_loss: 0.0565
Epoch 67/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0384 - val_loss: 0.0678
Epoch 68/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0412 - val_loss: 0.0507
Epoch 69/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0354 - val_loss: 0.0580
Epoch 70/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0371 - val_loss: 0.0535
Epoch 71/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0359 - val_loss: 0.0546
Epoch 72/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0370 - val_loss: 0.0494
Epoch 73/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0424 - val_loss: 0.0423
Epoch 74/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0414 - val_loss: 0.0466
Epoch 75/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0419 - val_loss: 0.0430
Epoch 76/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0411 - val_loss: 0.0436
Epoch 77/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0439 - val_loss: 0.0484
Epoch 78/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0407 - val_loss: 0.0519
Epoch 79/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0606
Epoch 80/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0413 - val_loss: 0.0626
Epoch 81/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0406 - val_loss: 0.0741
Epoch 82/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0384 - val_loss: 0.0651
Epoch 83/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0386 - val_loss: 0.0808
Epoch 84/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0371 - val_loss: 0.0775
Epoch 85/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0349 - val_loss: 0.0711
Epoch 86/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0325 - val_loss: 0.0738
Epoch 87/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0328 - val_loss: 0.0742
Epoch 88/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0338 - val_loss: 0.0562
Epoch 89/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0356 - val_loss: 0.0382
Epoch 90/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0364 - val_loss: 0.0532
Epoch 91/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0349 - val_loss: 0.0482
Epoch 92/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0344 - val_loss: 0.0590
Epoch 93/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0345 - val_loss: 0.0464
Epoch 94/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0337 - val_loss: 0.0474
Epoch 95/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0331 - val_loss: 0.0530
Epoch 96/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0310 - val_loss: 0.0558
Epoch 97/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0311 - val_loss: 0.0590
Epoch 98/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0288 - val_loss: 0.0686
Epoch 99/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0316 - val_loss: 0.0649
Epoch 100/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0296 - val_loss: 0.0653
Epoch 1/100
2023-11-26 16:27:02.628383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:02.628934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:02.629301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:27:02.708974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:02.709456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:02.709865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:27:02.871680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:02.872278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:02.872699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 5ms/step - loss: 0.2621 - val_loss: 0.0866
Epoch 2/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1621 - val_loss: 0.0873
Epoch 3/100
 1/51 [..............................] - ETA: 0s - loss: 0.1390
2023-11-26 16:27:03.302588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:03.303019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:03.303735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 2ms/step - loss: 0.1281 - val_loss: 0.0690
Epoch 4/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1274 - val_loss: 0.0725
Epoch 5/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1118 - val_loss: 0.0614
Epoch 6/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1057 - val_loss: 0.0634
Epoch 7/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1042 - val_loss: 0.0582
Epoch 8/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0931 - val_loss: 0.0528
Epoch 9/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0899 - val_loss: 0.0555
Epoch 10/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0930 - val_loss: 0.0605
Epoch 11/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0953 - val_loss: 0.0583
Epoch 12/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0915 - val_loss: 0.0595
Epoch 13/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0831 - val_loss: 0.0450
Epoch 14/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0750 - val_loss: 0.0590
Epoch 15/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0721 - val_loss: 0.0521
Epoch 16/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0710 - val_loss: 0.0523
Epoch 17/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0790 - val_loss: 0.0474
Epoch 18/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0762 - val_loss: 0.0464
Epoch 19/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0741 - val_loss: 0.0487
Epoch 20/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0723 - val_loss: 0.0456
Epoch 21/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0692 - val_loss: 0.0448
Epoch 22/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0619 - val_loss: 0.0438
Epoch 23/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0642 - val_loss: 0.0432
Epoch 24/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0650 - val_loss: 0.0448
Epoch 25/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0621 - val_loss: 0.0454
Epoch 26/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0609 - val_loss: 0.0489
Epoch 27/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0632 - val_loss: 0.0463
Epoch 28/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0683 - val_loss: 0.0428
Epoch 29/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0679 - val_loss: 0.0538
Epoch 30/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0763 - val_loss: 0.0500
Epoch 31/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0673 - val_loss: 0.0484
Epoch 32/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0633 - val_loss: 0.0425
Epoch 33/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0571 - val_loss: 0.0414
Epoch 34/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0614 - val_loss: 0.0451
Epoch 35/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0626 - val_loss: 0.0489
Epoch 36/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0602 - val_loss: 0.0406
Epoch 37/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0579 - val_loss: 0.0407
Epoch 38/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0546 - val_loss: 0.0406
Epoch 39/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0569 - val_loss: 0.0445
Epoch 40/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0586 - val_loss: 0.0426
Epoch 41/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0555 - val_loss: 0.0452
Epoch 42/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0553 - val_loss: 0.0425
Epoch 43/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0563 - val_loss: 0.0445
Epoch 44/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0535 - val_loss: 0.0390
Epoch 45/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0494 - val_loss: 0.0409
Epoch 46/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0499 - val_loss: 0.0405
Epoch 47/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0528 - val_loss: 0.0431
Epoch 48/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0564 - val_loss: 0.0453
Epoch 49/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0526 - val_loss: 0.0372
Epoch 50/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0496 - val_loss: 0.0421
Epoch 51/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0537 - val_loss: 0.0450
Epoch 52/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0532 - val_loss: 0.0437
Epoch 53/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0495 - val_loss: 0.0369
Epoch 54/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0451 - val_loss: 0.0395
Epoch 55/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0465 - val_loss: 0.0397
Epoch 56/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0464 - val_loss: 0.0376
Epoch 57/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0438 - val_loss: 0.0385
Epoch 58/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0456 - val_loss: 0.0390
Epoch 59/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0477 - val_loss: 0.0430
Epoch 60/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0502 - val_loss: 0.0406
Epoch 61/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0484 - val_loss: 0.0395
Epoch 62/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0468 - val_loss: 0.0412
Epoch 63/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0453 - val_loss: 0.0398
Epoch 64/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0451 - val_loss: 0.0394
Epoch 65/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0438 - val_loss: 0.0380
Epoch 66/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0411 - val_loss: 0.0385
Epoch 67/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0429 - val_loss: 0.0403
Epoch 68/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0425 - val_loss: 0.0391
Epoch 69/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0439 - val_loss: 0.0376
Epoch 70/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0437 - val_loss: 0.0428
Epoch 71/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0452 - val_loss: 0.0404
Epoch 72/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0412 - val_loss: 0.0377
Epoch 73/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0396 - val_loss: 0.0365
Epoch 74/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0405 - val_loss: 0.0382
Epoch 75/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0396 - val_loss: 0.0369
Epoch 76/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0385 - val_loss: 0.0365
Epoch 77/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0381 - val_loss: 0.0378
Epoch 78/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0382 - val_loss: 0.0371
Epoch 79/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0407 - val_loss: 0.0370
Epoch 80/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0392 - val_loss: 0.0381
Epoch 81/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0362 - val_loss: 0.0350
Epoch 82/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0374 - val_loss: 0.0372
Epoch 83/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0402 - val_loss: 0.0398
Epoch 84/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0381 - val_loss: 0.0352
Epoch 85/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0356 - val_loss: 0.0348
Epoch 86/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0350 - val_loss: 0.0363
Epoch 87/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0365 - val_loss: 0.0373
Epoch 88/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0384 - val_loss: 0.0352
Epoch 89/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0375 - val_loss: 0.0357
Epoch 90/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0342 - val_loss: 0.0347
Epoch 91/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0356 - val_loss: 0.0351
Epoch 92/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0354 - val_loss: 0.0367
Epoch 93/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0380 - val_loss: 0.0414
Epoch 94/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0374 - val_loss: 0.0325
Epoch 95/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0329 - val_loss: 0.0327
Epoch 96/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0313 - val_loss: 0.0334
Epoch 97/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0315 - val_loss: 0.0378
Epoch 98/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0339 - val_loss: 0.0360
Epoch 99/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0325 - val_loss: 0.0355
Epoch 100/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0316 - val_loss: 0.0365
Epoch 1/100
2023-11-26 16:27:13.378408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:13.379087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:13.379435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:27:13.462382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:13.462847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:13.463240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:27:13.819723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:13.820524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:13.820934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 4ms/step - loss: 0.1502 - val_loss: 0.1326
Epoch 2/100
58/68 [========================>.....] - ETA: 0s - loss: 0.1137
2023-11-26 16:27:14.278961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:14.279668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:14.280070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 2ms/step - loss: 0.1141 - val_loss: 0.1205
Epoch 3/100
68/68 [==============================] - 0s 2ms/step - loss: 0.1300 - val_loss: 0.1947
Epoch 4/100
68/68 [==============================] - 0s 2ms/step - loss: 0.1178 - val_loss: 0.1602
Epoch 5/100
68/68 [==============================] - 0s 2ms/step - loss: 0.1034 - val_loss: 0.1379
Epoch 6/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0924 - val_loss: 0.1648
Epoch 7/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0891 - val_loss: 0.1410
Epoch 8/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0789 - val_loss: 0.1285
Epoch 9/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0750 - val_loss: 0.1289
Epoch 10/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0766 - val_loss: 0.1296
Epoch 11/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0732 - val_loss: 0.1202
Epoch 12/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0727 - val_loss: 0.1025
Epoch 13/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0693 - val_loss: 0.1034
Epoch 14/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0698 - val_loss: 0.1234
Epoch 15/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0668 - val_loss: 0.1074
Epoch 16/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0661 - val_loss: 0.1355
Epoch 17/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0699 - val_loss: 0.0971
Epoch 18/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0692 - val_loss: 0.1144
Epoch 19/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0751 - val_loss: 0.0914
Epoch 20/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0684 - val_loss: 0.0868
Epoch 21/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0643 - val_loss: 0.1057
Epoch 22/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0628 - val_loss: 0.0994
Epoch 23/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0627 - val_loss: 0.0915
Epoch 24/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0644 - val_loss: 0.0794
Epoch 25/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0609 - val_loss: 0.0991
Epoch 26/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0614 - val_loss: 0.0905
Epoch 27/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0611 - val_loss: 0.0725
Epoch 28/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0590 - val_loss: 0.0873
Epoch 29/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0624 - val_loss: 0.0809
Epoch 30/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0571 - val_loss: 0.0735
Epoch 31/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0560 - val_loss: 0.0722
Epoch 32/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0580 - val_loss: 0.0695
Epoch 33/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0546 - val_loss: 0.0891
Epoch 34/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0607 - val_loss: 0.0630
Epoch 35/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0552 - val_loss: 0.0759
Epoch 36/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0542 - val_loss: 0.0659
Epoch 37/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0570 - val_loss: 0.0757
Epoch 38/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0574 - val_loss: 0.0552
Epoch 39/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0537 - val_loss: 0.0613
Epoch 40/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0489 - val_loss: 0.0709
Epoch 41/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0507 - val_loss: 0.0629
Epoch 42/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0502 - val_loss: 0.0645
Epoch 43/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0497 - val_loss: 0.0690
Epoch 44/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0507 - val_loss: 0.0659
Epoch 45/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0517 - val_loss: 0.0567
Epoch 46/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0483 - val_loss: 0.0731
Epoch 47/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0479 - val_loss: 0.0588
Epoch 48/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0477 - val_loss: 0.0581
Epoch 49/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0472 - val_loss: 0.0655
Epoch 50/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0480 - val_loss: 0.0594
Epoch 51/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0496 - val_loss: 0.0504
Epoch 52/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0451 - val_loss: 0.0666
Epoch 53/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0498 - val_loss: 0.0573
Epoch 54/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0457 - val_loss: 0.0668
Epoch 55/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0451 - val_loss: 0.0599
Epoch 56/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0474 - val_loss: 0.0529
Epoch 57/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0449 - val_loss: 0.0605
Epoch 58/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0457 - val_loss: 0.0548
Epoch 59/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0461 - val_loss: 0.0565
Epoch 60/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0427 - val_loss: 0.0603
Epoch 61/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0428 - val_loss: 0.0603
Epoch 62/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0420 - val_loss: 0.0583
Epoch 63/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0417 - val_loss: 0.0512
Epoch 64/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0426 - val_loss: 0.0568
Epoch 65/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0425 - val_loss: 0.0625
Epoch 66/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0423 - val_loss: 0.0548
Epoch 67/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0401 - val_loss: 0.0454
Epoch 68/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0393 - val_loss: 0.0552
Epoch 69/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0404 - val_loss: 0.0487
Epoch 70/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0400 - val_loss: 0.0572
Epoch 71/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0579
Epoch 72/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0409 - val_loss: 0.0589
Epoch 73/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0394 - val_loss: 0.0496
Epoch 74/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0385 - val_loss: 0.0509
Epoch 75/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0373 - val_loss: 0.0479
Epoch 76/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0380 - val_loss: 0.0441
Epoch 77/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0380 - val_loss: 0.0532
Epoch 78/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0389 - val_loss: 0.0504
Epoch 79/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0373 - val_loss: 0.0597
Epoch 80/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0392 - val_loss: 0.0527
Epoch 81/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0382 - val_loss: 0.0484
Epoch 82/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0358 - val_loss: 0.0531
Epoch 83/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0370 - val_loss: 0.0535
Epoch 84/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0370 - val_loss: 0.0469
Epoch 85/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0495
Epoch 86/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0380 - val_loss: 0.0470
Epoch 87/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0371 - val_loss: 0.0470
Epoch 88/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0401 - val_loss: 0.0418
Epoch 89/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0363 - val_loss: 0.0506
Epoch 90/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0390 - val_loss: 0.0468
Epoch 91/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0370 - val_loss: 0.0422
Epoch 92/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0382 - val_loss: 0.0411
Epoch 93/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0390 - val_loss: 0.0420
Epoch 94/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0405 - val_loss: 0.0396
Epoch 95/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0384 - val_loss: 0.0427
Epoch 96/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0389 - val_loss: 0.0470
Epoch 97/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0384 - val_loss: 0.0445
Epoch 98/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0410 - val_loss: 0.0395
Epoch 99/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0417 - val_loss: 0.0419
Epoch 100/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0433 - val_loss: 0.0418
Epoch 1/100
2023-11-26 16:27:27.337972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:27.338504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:27.338990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:27:27.420096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:27.420735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:27.421222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:27:27.583274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:27.583842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:27.584367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 4ms/step - loss: 0.1378 - val_loss: 0.0888
Epoch 2/100
59/85 [===================>..........] - ETA: 0s - loss: 0.1162
2023-11-26 16:27:28.076517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:28.077004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:28.077423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 2ms/step - loss: 0.1192 - val_loss: 0.0893
Epoch 3/100
85/85 [==============================] - 0s 2ms/step - loss: 0.1124 - val_loss: 0.0941
Epoch 4/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0902 - val_loss: 0.0777
Epoch 5/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0896 - val_loss: 0.0760
Epoch 6/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0762 - val_loss: 0.0733
Epoch 7/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0748 - val_loss: 0.0705
Epoch 8/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0812 - val_loss: 0.0713
Epoch 9/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0678 - val_loss: 0.0700
Epoch 10/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0661 - val_loss: 0.0660
Epoch 11/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0644 - val_loss: 0.0643
Epoch 12/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0639 - val_loss: 0.0627
Epoch 13/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0596 - val_loss: 0.0614
Epoch 14/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0584 - val_loss: 0.0604
Epoch 15/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0576 - val_loss: 0.0679
Epoch 16/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0566 - val_loss: 0.0597
Epoch 17/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0541 - val_loss: 0.0532
Epoch 18/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0548 - val_loss: 0.0609
Epoch 19/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0536 - val_loss: 0.0609
Epoch 20/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0532 - val_loss: 0.0574
Epoch 21/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0535 - val_loss: 0.0645
Epoch 22/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0494 - val_loss: 0.0515
Epoch 23/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0522 - val_loss: 0.0584
Epoch 24/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0526 - val_loss: 0.0499
Epoch 25/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0534 - val_loss: 0.0499
Epoch 26/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0497 - val_loss: 0.0566
Epoch 27/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0465 - val_loss: 0.0512
Epoch 28/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0498 - val_loss: 0.0571
Epoch 29/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0479 - val_loss: 0.0536
Epoch 30/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0453 - val_loss: 0.0442
Epoch 31/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0456 - val_loss: 0.0516
Epoch 32/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0468 - val_loss: 0.0523
Epoch 33/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0438 - val_loss: 0.0435
Epoch 34/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0454 - val_loss: 0.0458
Epoch 35/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0409 - val_loss: 0.0455
Epoch 36/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0417 - val_loss: 0.0482
Epoch 37/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0424 - val_loss: 0.0465
Epoch 38/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0403 - val_loss: 0.0507
Epoch 39/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0408 - val_loss: 0.0563
Epoch 40/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0400 - val_loss: 0.0488
Epoch 41/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0388 - val_loss: 0.0417
Epoch 42/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0369 - val_loss: 0.0445
Epoch 43/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0454
Epoch 44/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0383 - val_loss: 0.0415
Epoch 45/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0363 - val_loss: 0.0438
Epoch 46/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0371 - val_loss: 0.0470
Epoch 47/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0370 - val_loss: 0.0540
Epoch 48/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0346 - val_loss: 0.0477
Epoch 49/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0347 - val_loss: 0.0416
Epoch 50/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0341 - val_loss: 0.0516
Epoch 51/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0331 - val_loss: 0.0408
Epoch 52/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0341 - val_loss: 0.0445
Epoch 53/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0336 - val_loss: 0.0458
Epoch 54/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0341 - val_loss: 0.0446
Epoch 55/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0360 - val_loss: 0.0465
Epoch 56/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0360 - val_loss: 0.0514
Epoch 57/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0336 - val_loss: 0.0452
Epoch 58/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0311 - val_loss: 0.0446
Epoch 59/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0328 - val_loss: 0.0457
Epoch 60/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0328 - val_loss: 0.0481
Epoch 61/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0296 - val_loss: 0.0430
Epoch 62/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0330 - val_loss: 0.0452
Epoch 63/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0335 - val_loss: 0.0491
Epoch 64/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0314 - val_loss: 0.0367
Epoch 65/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0319 - val_loss: 0.0467
Epoch 66/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0284 - val_loss: 0.0418
Epoch 67/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0278 - val_loss: 0.0390
Epoch 68/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0385 - val_loss: 0.0341
Epoch 69/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0325 - val_loss: 0.0378
Epoch 70/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0333 - val_loss: 0.0350
Epoch 71/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0349 - val_loss: 0.0322
Epoch 72/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0290 - val_loss: 0.0387
Epoch 73/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0355 - val_loss: 0.0305
Epoch 74/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0329 - val_loss: 0.0345
Epoch 75/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0323 - val_loss: 0.0328
Epoch 76/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0305 - val_loss: 0.0341
Epoch 77/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0270 - val_loss: 0.0385
Epoch 78/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0278 - val_loss: 0.0355
Epoch 79/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0278 - val_loss: 0.0342
Epoch 80/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0282 - val_loss: 0.0347
Epoch 81/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0294 - val_loss: 0.0351
Epoch 82/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0357 - val_loss: 0.0302
Epoch 83/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0308 - val_loss: 0.0355
Epoch 84/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0320 - val_loss: 0.0308
Epoch 85/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0282 - val_loss: 0.0341
Epoch 86/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0309 - val_loss: 0.0322
Epoch 87/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0317 - val_loss: 0.0321
Epoch 88/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0330 - val_loss: 0.0317
Epoch 89/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0359 - val_loss: 0.0325
Epoch 90/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0356 - val_loss: 0.0314
Epoch 91/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0363 - val_loss: 0.0311
Epoch 92/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0402 - val_loss: 0.0298
Epoch 93/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0371 - val_loss: 0.0344
Epoch 94/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0328 - val_loss: 0.0320
Epoch 95/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0336 - val_loss: 0.0315
Epoch 96/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0325 - val_loss: 0.0301
Epoch 97/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0330 - val_loss: 0.0310
Epoch 98/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0311 - val_loss: 0.0302
Epoch 99/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0319 - val_loss: 0.0300
Epoch 100/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0338 - val_loss: 0.0314
Epoch 1/100
2023-11-26 16:27:44.514977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:44.515509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:44.516023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:27:44.676848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:27:44.677330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:27:44.677712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 1s 2ms/step - loss: 0.0363
Epoch 2/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0331
Epoch 3/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0311
Epoch 4/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0285
Epoch 5/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0269
Epoch 6/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0282
Epoch 7/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0259
Epoch 8/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0266
Epoch 9/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0260
Epoch 10/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0242
Epoch 11/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0234
Epoch 12/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0237
Epoch 13/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0225
Epoch 14/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0242
Epoch 15/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0280
Epoch 16/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0258
Epoch 17/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0223
Epoch 18/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0219
Epoch 19/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0228
Epoch 20/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0220
Epoch 21/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0222
Epoch 22/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0233
Epoch 23/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0245
Epoch 24/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0212
Epoch 25/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0219
Epoch 26/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0223
Epoch 27/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0205
Epoch 28/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0268
Epoch 29/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0223
Epoch 30/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0226
Epoch 31/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0236
Epoch 32/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0221
Epoch 33/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0198
Epoch 34/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0225
Epoch 35/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0192
Epoch 36/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0214
Epoch 37/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0211
Epoch 38/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0220
Epoch 39/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0205
Epoch 40/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0191
Epoch 41/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0221
Epoch 42/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0195
Epoch 43/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0205
Epoch 44/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0218
Epoch 45/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0193
Epoch 46/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0194
Epoch 47/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0196
Epoch 48/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0197
Epoch 49/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0188
Epoch 50/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0211
Epoch 51/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0190
Epoch 52/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0180
Epoch 53/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0179
Epoch 54/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0177
Epoch 55/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0183
Epoch 56/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0193
Epoch 57/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0191
Epoch 58/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0201
Epoch 59/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0192
Epoch 60/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0191
Epoch 61/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0178
Epoch 62/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0190
Epoch 63/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0181
Epoch 64/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0185
Epoch 65/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0174
Epoch 66/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0184
Epoch 67/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0200
Epoch 68/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0184
Epoch 69/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0185
Epoch 70/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0189
Epoch 71/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0223
Epoch 72/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0224
Epoch 73/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0213
Epoch 74/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0196
Epoch 75/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0257
Epoch 76/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0210
Epoch 77/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0237
Epoch 78/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0210
Epoch 79/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0227
Epoch 80/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0246
Epoch 81/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0259
Epoch 82/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0236
Epoch 83/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0229
Epoch 84/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0251
Epoch 85/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0231
Epoch 86/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0218
Epoch 87/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0261
Epoch 88/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0211
Epoch 89/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0244
Epoch 90/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0255
Epoch 91/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0257
Epoch 92/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0204
Epoch 93/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0238
Epoch 94/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0236
Epoch 95/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0226
Epoch 96/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0253
Epoch 97/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0225
Epoch 98/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0244
Epoch 99/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0230
Epoch 100/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0248
<keras.callbacks.History at 0x2c65d2850>
Code
# Generate predictions
train_pred = model_final.predict(X_train).flatten()  # Flatten to ensure it's a 1D array
test_pred = model_final.predict(X_test).flatten()

# Create DataFrames for the actual and predicted values with proper indexing
# Ensure the index is constructed correctly for the training ground truth
train_indices = [x[0] for x in train_series]
train_gt = pd.DataFrame(y_train, columns=['y'], index=train_indices)
train_pred_df = pd.DataFrame(train_pred, columns=['yhat'], index=train_indices)

# Plot training predictions and actual values
pd.concat([train_gt, train_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Training Data: Actual vs Predicted')

# Ensure the index is constructed correctly 
test_indices = [x[0] for x in test_series]
test_gt = pd.DataFrame(y_test, columns=['y'], index=test_indices)
test_pred_df = pd.DataFrame(test_pred, columns=['yhat'], index=test_indices)

# Plot test predictions and actual values
pd.concat([test_gt, test_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Test Data: Actual vs Predicted')
plt.show()
102/102 [==============================] - 0s 525us/step
34/34 [==============================] - 0s 590us/step
2023-11-26 16:28:02.617812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:02.618306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:02.618880: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

Code
# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}")
print(f"RMSE: {train_rmse}")
print(f"R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}")
print(f"RMSE: {test_rmse}")
print(f"R2: {test_r2}")
Training Metrics:
MAE: 0.017095310668130956
RMSE: 0.021996564985694526
R2: 0.9757170342291843

Test Metrics:
MAE: 0.038986852071342476
RMSE: 0.07106591544930309
R2: 0.7229041383644761

To tune the model and reduce overfitting, I employed a learning rate scheduler that increases the rate until epoch reaches 10 and then decays it every 10 epochs to help the model converge quickly but fine-tune slowly.

Next, the build_model function defines the architecture of the model by taking the hyperparameters I am tuning as inputs. It consists of two LSTM layers, dropout layers to prevent overfitting, and a final dense layer with a sigmoid activation function as it naturally constrains the output to be within the range of 0 to 1, which aligns with the nature of the response variable (a proportion or percentage). Then, the model is compiled with the Adam optimizer and MAE loss.

I then defined two training callbacks: 1. lr_scheduler uses LearningRateScheduler() to adjust the learning rate based on my scheduler function (Chollet, n.d.). 2. early_stopping monitors the validation loss, terminates the training process if that loss does not improve after 20 epochs, and restores the best weights observed during training.

As for the hyperparameter grid search, I decided to focus on tuning the number of neurons, dropout rates, L1 and L2 regularization strengths, and batch sizes. For these, I created lists for five hyperparameters to iterate over in nested loops to try all of the possible combinations.

Within these nested loops, cross validation is performed using tscv.split on the train data as I previously described in the base model. In each of these folds, a model is developed with the current combination of hyperparameters and trained on the training set all while monitoring that validation set’s performance and using the callbacks.

After each round of training, the best validation loss for that fold is recorded as well as the average validation loss across the folds. For the sets of hyperparameters producing a lower average validation loss than the best configuration already created, the best_val_loss and best_config variables are updated.

Once all of the hyperparameter combinations are evaluated, the final model using the best configuration obtained during hyperparameter tuning is rebuilt, compiled, and trained on the full training dataset. That model is then evaluated by various metrics.

I had various initial models that I had created that had issues that I improved on in this model. Those model versions can be found in the LSTM Initial Models section of the appendix.

Many of the issues I faced during training came down to me trying too hard to conform to the methods Professor Shi used in her LSTM notebook as I tried to normalize my data and impute missing values with zeros. I also did not implement cross validations in many of my initial models which caused both overfitting and general lack of training accuracy. Finally, I faced long run times when running the tuning for-loops due to their computational complexities.

Code
# Learning rate scheduler for training
def scheduler(epoch, lr):
    if epoch < 10:
        return lr
    else:
        return lr * np.exp(-0.1 * (epoch // 10))  # More aggressive decay every 10 epochs

# Function to build LSTM model
def build_model(input_shape, output_units=1, neurons=16, dropout=0.3, l1_reg=0.0001, l2_reg=0.0001):
    model = Sequential()
    model.add(LSTM(neurons, return_sequences=True, input_shape=input_shape,
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(LSTM(neurons, return_sequences=False, 
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(Dense(output_units, activation='sigmoid'))
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')
    return model

# Callbacks for training
lr_schedule = LearningRateScheduler(scheduler)
early_stopping = EarlyStopping(monitor='val_loss', patience=20, restore_best_weights=True)

# Hyperparameters to iterate over
neurons_options = [16, 32]
dropout_options = [0.2, 0.3]
l1_reg_options = [0.0001, 0.00001]
l2_reg_options = [0.0001, 0.00001]
batch_sizes = [32, 64, 128]

# Initialize variables to track the best model configuration
best_val_loss = float('inf')
best_config = {}

# Input shape for LSTM layers
input_shape = (sequence_length, X_train.shape[2])

# Loop over all combinations of hyperparameters
for neurons in neurons_options:
    for dropout in dropout_options:
        for l1_reg in l1_reg_options:
            for l2_reg in l2_reg_options:
                for batch_size in batch_sizes:
                    print(f"Training with neurons: {neurons}, dropout: {dropout}, l1_reg: {l1_reg}, l2_reg: {l2_reg}, batch_size: {batch_size}")
                    
                    # Initialize variables for cross-validation
                    cv_val_loss = []
                    
                    for train_index, val_index in tscv.split(X_train):
                        X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
                        y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

                        # Build the model with current hyperparameters
                        model = build_model(input_shape, output_units=1, neurons=neurons, dropout=dropout, l1_reg=l1_reg, l2_reg=l2_reg)
                        
                        # Train the model on this fold
                        history = model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=batch_size,
                                            validation_data=(X_val_fold, y_val_fold), shuffle=False, callbacks=[lr_schedule, early_stopping])
                        
                        # Record the best validation loss for this fold
                        cv_val_loss.append(min(history.history['val_loss']))
                    
                    # Average validation loss across all folds
                    avg_val_loss = np.mean(cv_val_loss)
                    
                    # Update the best model configuration if the current one is better
                    if avg_val_loss < best_val_loss:
                        best_val_loss = avg_val_loss
                        best_config = {'neurons': neurons, 'dropout': dropout, 'l1_reg': l1_reg, 'l2_reg': l2_reg, 'batch_size': batch_size}
                        
                    print(f"Average Validation Loss: {avg_val_loss}")
                    print(f"Current Best Configuration: {best_config}")

# Rebuild the model using the best configuration
model_final = build_model(input_shape, output_units=1, neurons=best_config['neurons'], dropout=best_config['dropout'], l1_reg=best_config['l1_reg'], l2_reg=best_config['l2_reg'])
model_final.compile(optimizer=Adam(learning_rate=0.001), loss='mae')

# Retrain the final model on the full training data
model_final.fit(X_train, y_train, epochs=100, batch_size=best_config['batch_size'], shuffle=False, callbacks=[lr_schedule, early_stopping])
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:28:03.073229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:03.073863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:03.074365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:03.130739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:03.131172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:03.131559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:03.217517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:03.217941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:03.218363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:03.279730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:03.280467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:03.280885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:03.513704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:03.514174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:03.514810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:03.572970: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:03.573429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:03.573877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.1702 - val_loss: 0.1938 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1577
2023-11-26 16:28:04.186774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:04.187203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:04.187599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:04.248456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:04.248908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:04.249303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1703 - val_loss: 0.1685 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1600 - val_loss: 0.1571 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1426 - val_loss: 0.1593 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1387 - val_loss: 0.1570 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1357 - val_loss: 0.1495 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1296 - val_loss: 0.1456 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1197 - val_loss: 0.1383 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1007 - val_loss: 0.1597 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1225 - val_loss: 0.1282 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0911 - val_loss: 0.1347 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0889 - val_loss: 0.1384 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0883 - val_loss: 0.1304 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0819 - val_loss: 0.1248 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0767 - val_loss: 0.1196 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.1375 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0811 - val_loss: 0.1261 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.1264 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.1203 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.1202 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.1179 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.1226 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.1204 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0645 - val_loss: 0.1249 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.1193 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.1230 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.1187 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0643 - val_loss: 0.1224 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0653 - val_loss: 0.1208 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.1178 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.1182 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.1190 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.1182 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.1191 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.1191 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0625 - val_loss: 0.1187 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.1189 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.1186 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.1186 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.1186 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.1186 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.1186 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0635 - val_loss: 0.1185 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.1185 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.1185 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0645 - val_loss: 0.1186 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0644 - val_loss: 0.1186 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.1186 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.1186 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0625 - val_loss: 0.1186 - lr: 4.5400e-08
Epoch 1/100
2023-11-26 16:28:07.641633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:07.642134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:07.642479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:07.692841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:07.693201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:07.693525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:07.772185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:07.772674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:07.773095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:07.831422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:07.831896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:07.832341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:08.015487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:08.015945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:08.016392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:08.075707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:08.076180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:08.076608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1990 - val_loss: 0.1278 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1390
2023-11-26 16:28:08.562385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:08.562883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:08.563540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:08.624112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:08.624540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:08.624933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1767 - val_loss: 0.1259 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1640 - val_loss: 0.1166 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1556 - val_loss: 0.1113 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1491 - val_loss: 0.1022 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1431 - val_loss: 0.1031 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1406 - val_loss: 0.0933 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1321 - val_loss: 0.1066 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1292 - val_loss: 0.0878 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1292 - val_loss: 0.1020 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1206 - val_loss: 0.0926 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1170 - val_loss: 0.1017 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1128 - val_loss: 0.0876 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1063 - val_loss: 0.1149 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0996 - val_loss: 0.1009 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1025 - val_loss: 0.0989 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0949 - val_loss: 0.1016 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0921 - val_loss: 0.0993 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0904 - val_loss: 0.0951 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0837 - val_loss: 0.0925 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0805 - val_loss: 0.0913 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0793 - val_loss: 0.0919 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0764 - val_loss: 0.0901 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0750 - val_loss: 0.0905 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0746 - val_loss: 0.0911 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0729 - val_loss: 0.0914 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0721 - val_loss: 0.0913 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0709 - val_loss: 0.0911 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0712 - val_loss: 0.0918 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0705 - val_loss: 0.0929 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0711 - val_loss: 0.0926 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0714 - val_loss: 0.0912 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0706 - val_loss: 0.0920 - lr: 2.0242e-05
Epoch 1/100
2023-11-26 16:28:11.481498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:11.481919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:11.482359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:11.533093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:11.533447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:11.533797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:11.614798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:11.615250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:11.615689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:11.674844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:11.675321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:11.675737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:11.909211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:11.909703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:11.910147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:11.968026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:11.968463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:11.968908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 8ms/step - loss: 0.1727 - val_loss: 0.1593 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1017
2023-11-26 16:28:12.673389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:12.673858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:12.674332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:12.736049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:12.736542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:12.736949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1463 - val_loss: 0.1395 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1358 - val_loss: 0.1276 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1283 - val_loss: 0.1216 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1239 - val_loss: 0.1160 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1165 - val_loss: 0.1110 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1118 - val_loss: 0.1055 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1096 - val_loss: 0.1052 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1046 - val_loss: 0.0990 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1021 - val_loss: 0.1006 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0958 - val_loss: 0.0877 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0904 - val_loss: 0.0892 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0853 - val_loss: 0.0828 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0795 - val_loss: 0.0797 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0761 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0678 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0659 - val_loss: 0.0701 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0684 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0644 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0641 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0638 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0635 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0633 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0637 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0611 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0599 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0594 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0593 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0599 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0600 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0597 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0599 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0598 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0597 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0600 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0599 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0599 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0599 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0600 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0600 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0600 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0600 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0600 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0600 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0600 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0600 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0600 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0600 - lr: 1.0104e-07
Epoch 1/100
2023-11-26 16:28:20.063550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:20.063968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:20.064561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:20.116995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:20.117356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:20.117695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:20.199542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:20.200029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:20.200536: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:20.261042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:20.261563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:20.261992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:20.793027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:20.793666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:20.794063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:20.854207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:20.854750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:20.855196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 2s 7ms/step - loss: 0.1717 - val_loss: 0.1686 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1795
2023-11-26 16:28:21.645034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:21.645640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:21.646087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:21.710987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:21.711440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:21.711823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1537 - val_loss: 0.1523 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1386 - val_loss: 0.1431 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1306 - val_loss: 0.1305 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1235 - val_loss: 0.1341 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1194 - val_loss: 0.1121 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1132 - val_loss: 0.1252 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1130 - val_loss: 0.1156 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1065 - val_loss: 0.1136 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1004 - val_loss: 0.1032 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0958 - val_loss: 0.0953 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0907 - val_loss: 0.0906 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0859 - val_loss: 0.0911 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0838 - val_loss: 0.0893 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0785 - val_loss: 0.0876 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0822 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0815 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0773 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0750 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0668 - val_loss: 0.0756 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0724 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0732 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0742 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0775 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0733 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0725 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0682 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0641 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0628 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0610 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0606 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0604 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0601 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0600 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0599 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0599 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0599 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0599 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0599 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0598 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0598 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0598 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0598 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0598 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0598 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0598 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0598 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0598 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0598 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0598 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0598 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0598 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0598 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0598 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0598 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0598 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0598 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0598 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0598 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0598 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0598 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0598 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0598 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0598 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0598 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0598 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0598 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0598 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0598 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0598 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0598 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0598 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0598 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0598 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0598 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0598 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0598 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0598 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0598 - lr: 1.3924e-15
Epoch 1/100
2023-11-26 16:28:37.303808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:37.304170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:37.304615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:37.355873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:37.356245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:37.356590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:37.437266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:37.437742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:37.438171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:37.498298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:37.498770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:37.499196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:37.738466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:37.739220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:37.739683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:37.797283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:37.797736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:37.798144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1645 - val_loss: 0.1452 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1174
2023-11-26 16:28:38.601125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:38.601552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:38.602054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:38.665408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:38.665846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:38.666245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1361 - val_loss: 0.1302 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1216 - val_loss: 0.1207 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1142 - val_loss: 0.1165 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1129 - val_loss: 0.1127 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1010 - val_loss: 0.1087 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0990 - val_loss: 0.1038 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0919 - val_loss: 0.1002 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0864 - val_loss: 0.0955 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0820 - val_loss: 0.0924 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0884 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0733 - val_loss: 0.0852 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0828 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0819 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0794 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0773 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0750 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0760 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0751 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0722 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0693 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0688 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0669 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0658 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0650 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0643 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0636 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0631 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0627 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0621 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0616 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0613 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0608 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0607 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0605 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0604 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0603 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0602 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0602 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0601 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0601 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0601 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0601 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0601 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0601 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0601 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0601 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0601 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0601 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0601 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0601 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0601 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0601 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0601 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0601 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0601 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0601 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0601 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0601 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0601 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0601 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0601 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0601 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0601 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0601 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0601 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0601 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0601 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0601 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0601 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0601 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0601 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0601 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0601 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0601 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0601 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0601 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0601 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0601 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0601 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0601 - lr: 3.1068e-16
Epoch 82/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0601 - lr: 1.3960e-16
Average Validation Loss: 0.0769047386944294
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
2023-11-26 16:28:58.436942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:58.437482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:58.437848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:58.491300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:58.491778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:58.492236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:58.577305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:58.577775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:58.578222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:58.642733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:58.643493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:58.643903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:58.884028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:58.884706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:58.885130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:58.947546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:58.948030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:58.948445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.2075 - val_loss: 0.1922 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1259
2023-11-26 16:28:59.552967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:59.553464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:59.554033: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:28:59.615225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:28:59.615663: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:28:59.616055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 5ms/step - loss: 0.1677 - val_loss: 0.1897 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1651 - val_loss: 0.1873 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1561 - val_loss: 0.1796 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1518 - val_loss: 0.1717 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1463 - val_loss: 0.1666 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1396 - val_loss: 0.1661 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1376 - val_loss: 0.1632 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1331 - val_loss: 0.1577 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1241 - val_loss: 0.1595 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1197 - val_loss: 0.1565 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1145 - val_loss: 0.1512 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1061 - val_loss: 0.1495 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1008 - val_loss: 0.1475 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0978 - val_loss: 0.1449 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0962 - val_loss: 0.1420 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.1410 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0873 - val_loss: 0.1432 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.1365 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.1443 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.1373 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1388 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1375 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.1388 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.1407 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0784 - val_loss: 0.1380 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.1355 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.1368 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.1383 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1378 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.1376 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.1374 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.1374 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.1375 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.1375 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1377 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.1376 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.1375 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.1375 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.1375 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.1375 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.1375 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.1375 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.1375 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.1375 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1375 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.1374 - lr: 1.5073e-07
Epoch 1/100
2023-11-26 16:29:01.822031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:01.822506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:01.822850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:01.876718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:01.877092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:01.877459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:01.966153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:01.966723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:01.967178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:02.030360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:02.030986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:02.031401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:02.214509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:02.214963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:02.215367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:02.273112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:02.273661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:02.274142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 18ms/step - loss: 0.1994 - val_loss: 0.1356 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1193
2023-11-26 16:29:02.736980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:02.737479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:02.738140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:02.799025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:02.799471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:02.799862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 3ms/step - loss: 0.1712 - val_loss: 0.1288 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1597 - val_loss: 0.1168 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1526 - val_loss: 0.1168 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1454 - val_loss: 0.1112 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1377 - val_loss: 0.1105 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1297 - val_loss: 0.1057 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1268 - val_loss: 0.1084 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1192 - val_loss: 0.1067 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1194 - val_loss: 0.0983 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1103 - val_loss: 0.1038 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1030 - val_loss: 0.0998 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1008 - val_loss: 0.0949 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0977 - val_loss: 0.0933 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0928 - val_loss: 0.0908 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0885 - val_loss: 0.0898 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0859 - val_loss: 0.0887 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0844 - val_loss: 0.0937 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0826 - val_loss: 0.0915 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0817 - val_loss: 0.0876 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0852 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0863 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0911 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0787 - val_loss: 0.0859 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0774 - val_loss: 0.0902 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0770 - val_loss: 0.0892 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0765 - val_loss: 0.0887 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0777 - val_loss: 0.0887 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0768 - val_loss: 0.0874 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.0880 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0764 - val_loss: 0.0892 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0757 - val_loss: 0.0882 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0880 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0885 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0755 - val_loss: 0.0881 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0878 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0758 - val_loss: 0.0880 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0880 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0880 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0749 - val_loss: 0.0881 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0756 - val_loss: 0.0882 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:29:05.171251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:05.171708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:05.172272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:05.227151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:05.227613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:05.227964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:05.312019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:05.312521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:05.312951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:05.372441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:05.372930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:05.373609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:05.615654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:05.616113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:05.616550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:05.675719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:05.676187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:05.676606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 14ms/step - loss: 0.2015 - val_loss: 0.1726 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1419
2023-11-26 16:29:06.318705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:06.319187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:06.319854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:06.379905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:06.380347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:06.380734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.1682 - val_loss: 0.1710 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1514 - val_loss: 0.1536 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1460 - val_loss: 0.1434 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1392 - val_loss: 0.1361 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1347 - val_loss: 0.1321 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1279 - val_loss: 0.1239 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1239 - val_loss: 0.1172 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1221 - val_loss: 0.1131 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1194 - val_loss: 0.1082 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1100 - val_loss: 0.1026 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1072 - val_loss: 0.0958 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1021 - val_loss: 0.0879 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0975 - val_loss: 0.0816 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0923 - val_loss: 0.0739 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0853 - val_loss: 0.0718 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0851 - val_loss: 0.0712 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0850 - val_loss: 0.0708 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0844 - val_loss: 0.0717 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0867 - val_loss: 0.0710 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0880 - val_loss: 0.0681 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0835 - val_loss: 0.0706 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0832 - val_loss: 0.0771 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0780 - val_loss: 0.0763 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0780 - val_loss: 0.0754 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0764 - val_loss: 0.0755 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0748 - val_loss: 0.0744 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0746 - val_loss: 0.0740 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0733 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.0721 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0741 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.0737 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0728 - val_loss: 0.0735 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0738 - val_loss: 0.0738 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0735 - val_loss: 0.0734 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0738 - val_loss: 0.0735 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0733 - val_loss: 0.0733 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.0733 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.0732 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0730 - val_loss: 0.0733 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.0733 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:29:10.322697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:10.323202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:10.323730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:10.374529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:10.374904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:10.375410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:10.458935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:10.459418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:10.459839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:10.518942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:10.519408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:10.519830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:10.763461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:10.764054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:10.764582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:10.829152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:10.829868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:10.830334: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 2s 12ms/step - loss: 0.1885 - val_loss: 0.1594 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1241
2023-11-26 16:29:11.855364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:11.856053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:11.856558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:11.921723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:11.922132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:11.922526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.1534 - val_loss: 0.1490 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1387 - val_loss: 0.1396 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1289 - val_loss: 0.1342 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1225 - val_loss: 0.1271 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1161 - val_loss: 0.1192 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1108 - val_loss: 0.1193 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1053 - val_loss: 0.1152 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1022 - val_loss: 0.1070 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0986 - val_loss: 0.1079 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0949 - val_loss: 0.1010 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0894 - val_loss: 0.0992 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0876 - val_loss: 0.0977 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0876 - val_loss: 0.0993 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0840 - val_loss: 0.0991 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0826 - val_loss: 0.0996 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0822 - val_loss: 0.0992 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0826 - val_loss: 0.0978 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0817 - val_loss: 0.0967 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.0921 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0835 - val_loss: 0.0877 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0829 - val_loss: 0.0721 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0764 - val_loss: 0.0678 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.0655 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0733 - val_loss: 0.0640 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0730 - val_loss: 0.0633 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0628 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0623 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0689 - val_loss: 0.0623 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0620 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0618 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0617 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0617 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0616 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0616 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0616 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0616 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0616 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0615 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0615 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0676 - val_loss: 0.0615 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0615 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0615 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0615 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0615 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0676 - val_loss: 0.0615 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0682 - val_loss: 0.0615 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0615 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0615 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0615 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0615 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0615 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0615 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0615 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0676 - val_loss: 0.0615 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0615 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0674 - val_loss: 0.0615 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0615 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0615 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0615 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0615 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0615 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0682 - val_loss: 0.0615 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0615 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0682 - val_loss: 0.0615 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0615 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0615 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0615 - lr: 2.2897e-14
Epoch 1/100
2023-11-26 16:29:20.814512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:20.814963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:20.815344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:20.867195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:20.867605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:20.867962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:20.955589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:20.956072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:20.956494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:21.017432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:21.017968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:21.018435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:21.251885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:21.252399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:21.252811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:21.310743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:21.311196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:21.311616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 10ms/step - loss: 0.1886 - val_loss: 0.1565 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1184
2023-11-26 16:29:22.004820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:22.005310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:22.006012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:22.071343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:22.071807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:22.072191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.1544 - val_loss: 0.1429 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1350 - val_loss: 0.1299 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1169 - val_loss: 0.1212 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1119 - val_loss: 0.1147 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1023 - val_loss: 0.1112 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0991 - val_loss: 0.1071 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0945 - val_loss: 0.1038 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0922 - val_loss: 0.1004 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0882 - val_loss: 0.0998 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0846 - val_loss: 0.0941 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0926 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0774 - val_loss: 0.0880 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.0849 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0835 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0811 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0663 - val_loss: 0.0768 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0748 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0724 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0715 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0703 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0690 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0692 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0690 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0688 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0685 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0685 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0680 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0663 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0657 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0651 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0648 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0649 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0647 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0648 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0648 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0646 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0646 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0646 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0646 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0646 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0646 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0646 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0646 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0544 - val_loss: 0.0646 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0646 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0646 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0646 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0646 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0646 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0646 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0646 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0646 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0646 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0646 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0646 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0646 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0646 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0646 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0646 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0646 - lr: 1.6788e-10
Average Validation Loss: 0.08298397064208984
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:29:30.901960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:30.902950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:30.903616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:30.965993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:30.966413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:30.966902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:31.054816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:31.055326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:31.055681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:31.117729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:31.118214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:31.118825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:31.354161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:31.354607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:31.355045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:31.412480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:31.412933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:31.413365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 66ms/step - loss: 0.2306 - val_loss: 0.1979 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1399
2023-11-26 16:29:31.971744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:31.972216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:31.972870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:32.032720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:32.033133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:32.033513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 8ms/step - loss: 0.1711 - val_loss: 0.1872 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1588 - val_loss: 0.1941 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1636 - val_loss: 0.1987 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1640 - val_loss: 0.1983 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1637 - val_loss: 0.1947 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1605 - val_loss: 0.1890 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1556 - val_loss: 0.1829 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1525 - val_loss: 0.1775 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1491 - val_loss: 0.1727 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1433 - val_loss: 0.1690 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1391 - val_loss: 0.1668 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1331 - val_loss: 0.1666 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1342 - val_loss: 0.1651 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1275 - val_loss: 0.1642 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1244 - val_loss: 0.1624 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1202 - val_loss: 0.1607 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1172 - val_loss: 0.1587 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1143 - val_loss: 0.1578 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1117 - val_loss: 0.1579 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1080 - val_loss: 0.1579 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1073 - val_loss: 0.1580 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1059 - val_loss: 0.1565 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1049 - val_loss: 0.1549 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1031 - val_loss: 0.1549 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1026 - val_loss: 0.1551 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1008 - val_loss: 0.1553 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1026 - val_loss: 0.1555 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0999 - val_loss: 0.1555 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1008 - val_loss: 0.1556 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1002 - val_loss: 0.1557 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1004 - val_loss: 0.1557 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1005 - val_loss: 0.1556 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0983 - val_loss: 0.1555 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0987 - val_loss: 0.1554 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0986 - val_loss: 0.1553 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0997 - val_loss: 0.1553 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0994 - val_loss: 0.1552 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0977 - val_loss: 0.1552 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1002 - val_loss: 0.1552 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1000 - val_loss: 0.1552 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0974 - val_loss: 0.1552 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1016 - val_loss: 0.1552 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0983 - val_loss: 0.1552 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0976 - val_loss: 0.1551 - lr: 3.3546e-07
Epoch 1/100
2023-11-26 16:29:33.642332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:33.642771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:33.643233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:33.696725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:33.697114: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:33.697488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:33.776963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:33.777436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:33.777888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:33.837217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:33.837680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:33.838116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:34.070379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:34.070818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:34.071319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:34.130101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:34.130559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:34.130973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.2652 - val_loss: 0.2262 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1472
2023-11-26 16:29:34.707806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:34.708357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:34.708847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:34.771760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:34.772196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:34.772607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1895 - val_loss: 0.1503 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1685 - val_loss: 0.1304 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1679 - val_loss: 0.1240 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1598 - val_loss: 0.1230 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1544 - val_loss: 0.1288 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1469 - val_loss: 0.1262 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1396 - val_loss: 0.1171 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1316 - val_loss: 0.1193 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1263 - val_loss: 0.1105 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1182 - val_loss: 0.1159 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1109 - val_loss: 0.1196 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1076 - val_loss: 0.1109 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1049 - val_loss: 0.1112 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1011 - val_loss: 0.1162 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1018 - val_loss: 0.1098 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0988 - val_loss: 0.1089 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0974 - val_loss: 0.1069 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.1096 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0963 - val_loss: 0.1077 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.1084 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0933 - val_loss: 0.1060 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0933 - val_loss: 0.1124 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.1073 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0916 - val_loss: 0.1052 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.1064 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.1059 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.1049 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.1074 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.1089 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.1078 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.1055 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0902 - val_loss: 0.1050 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.1051 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.1049 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.1049 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.1051 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.1052 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0904 - val_loss: 0.1054 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.1055 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.1056 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.1056 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.1056 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0913 - val_loss: 0.1056 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.1056 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.1056 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.1056 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0902 - val_loss: 0.1056 - lr: 1.0104e-07
Epoch 1/100
2023-11-26 16:29:37.193173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:37.193576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:37.194040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:37.244505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:37.244874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:37.245218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:37.326723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:37.327187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:37.327565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:37.386966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:37.387422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:37.387834: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:37.619877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:37.620336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:37.620853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:37.678809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:37.679293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:37.679713: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 25ms/step - loss: 0.2017 - val_loss: 0.1871 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1655
2023-11-26 16:29:38.273560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:38.274074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:38.274729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:38.335242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:38.335668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:38.336051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1704 - val_loss: 0.1746 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1603 - val_loss: 0.1740 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1531 - val_loss: 0.1629 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1463 - val_loss: 0.1550 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1418 - val_loss: 0.1485 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1342 - val_loss: 0.1393 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1311 - val_loss: 0.1321 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1273 - val_loss: 0.1254 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1227 - val_loss: 0.1196 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1174 - val_loss: 0.1176 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1136 - val_loss: 0.1130 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1102 - val_loss: 0.1109 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1075 - val_loss: 0.1086 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1048 - val_loss: 0.1030 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1038 - val_loss: 0.1021 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1005 - val_loss: 0.1027 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0986 - val_loss: 0.0993 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0975 - val_loss: 0.0967 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.0972 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.0945 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0960 - val_loss: 0.0963 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0939 - val_loss: 0.0953 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0936 - val_loss: 0.0955 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.0934 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0927 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0939 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.0935 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0940 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0934 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.0930 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.0929 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0929 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.0927 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0901 - val_loss: 0.0927 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0928 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0902 - val_loss: 0.0928 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0911 - val_loss: 0.0928 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0928 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.0928 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.0928 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0917 - val_loss: 0.0928 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.0928 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0928 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.0928 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0928 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.0928 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0928 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0928 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.0928 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.0928 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.0928 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.0928 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0928 - lr: 6.1442e-09
Epoch 1/100
2023-11-26 16:29:41.925460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:41.926035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:41.926387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:41.977427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:41.977769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:41.978264: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:42.063432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:42.063936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:42.064361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:42.125971: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:42.126445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:42.127155: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:42.362183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:42.362675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:42.363321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:42.421879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:42.422337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:42.422745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 20ms/step - loss: 0.1907 - val_loss: 0.1657 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1835
2023-11-26 16:29:43.036083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:43.036593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:43.037247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:43.098635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:43.099129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:43.099455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1640 - val_loss: 0.1524 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1507 - val_loss: 0.1516 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1448 - val_loss: 0.1315 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1320 - val_loss: 0.1339 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1263 - val_loss: 0.1340 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1201 - val_loss: 0.1281 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1144 - val_loss: 0.1219 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1085 - val_loss: 0.1263 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1062 - val_loss: 0.1222 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1026 - val_loss: 0.1112 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0972 - val_loss: 0.1062 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0929 - val_loss: 0.0972 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0947 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0861 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0872 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0821 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0817 - val_loss: 0.0774 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0808 - val_loss: 0.0718 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0663 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.0657 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0660 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0660 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0653 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0654 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0652 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0656 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0652 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0650 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0647 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0647 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0646 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0646 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0646 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0647 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0646 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0647 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0647 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0647 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0647 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0647 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0647 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0647 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.0647 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0647 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.0647 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.0647 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0647 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0647 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0647 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0647 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0647 - lr: 1.6702e-08
Epoch 1/100
2023-11-26 16:29:47.348231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:47.348684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:47.349038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:47.401077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:47.401473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:47.401825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:47.481115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:47.481590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:47.482001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:47.541400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:47.541866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:47.542288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:48.149837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:48.150292: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:48.150903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:48.208872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:48.209339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:48.209764: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 2s 16ms/step - loss: 0.1912 - val_loss: 0.1663 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2050
2023-11-26 16:29:48.836718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:48.837180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:48.837872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:48.899820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:48.900275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:48.900668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 5ms/step - loss: 0.1692 - val_loss: 0.1557 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1513 - val_loss: 0.1490 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1411 - val_loss: 0.1428 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1384 - val_loss: 0.1412 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1316 - val_loss: 0.1330 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1232 - val_loss: 0.1265 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1153 - val_loss: 0.1224 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1119 - val_loss: 0.1197 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1114 - val_loss: 0.1234 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1109 - val_loss: 0.1198 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1037 - val_loss: 0.1142 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0985 - val_loss: 0.1100 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0950 - val_loss: 0.1107 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0928 - val_loss: 0.1087 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0902 - val_loss: 0.1046 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0854 - val_loss: 0.1020 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0834 - val_loss: 0.1002 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0977 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.0918 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.0906 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0879 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.0865 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0860 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0844 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.0842 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.0838 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0837 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0728 - val_loss: 0.0829 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0720 - val_loss: 0.0825 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.0823 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0824 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0823 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0822 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.0821 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.0820 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0820 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0725 - val_loss: 0.0820 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0819 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0819 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0819 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0712 - val_loss: 0.0819 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.0819 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0819 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0819 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0819 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0819 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0819 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0819 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0819 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0819 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0819 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0819 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0819 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0819 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0819 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0819 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0819 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0819 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0819 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0720 - val_loss: 0.0819 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0819 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0819 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0819 - lr: 2.7751e-11
Average Validation Loss: 0.0997678980231285
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:29:55.310290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:55.310652: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:55.311071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:55.362781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:55.363158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:55.363513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:55.442776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:55.443261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:55.443753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:55.503077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:55.503540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:55.503963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:55.736859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:55.737310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:55.737725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:55.795669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:55.796132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:55.796551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.1668 - val_loss: 0.1965 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1633
2023-11-26 16:29:56.399434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:56.399928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:56.400618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:56.461649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:56.462066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:56.462432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1651 - val_loss: 0.1813 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1562 - val_loss: 0.1695 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1464 - val_loss: 0.1662 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1371 - val_loss: 0.1664 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1390 - val_loss: 0.1611 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1355 - val_loss: 0.1549 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1251 - val_loss: 0.1519 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1207 - val_loss: 0.1529 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1154 - val_loss: 0.1458 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1065 - val_loss: 0.1437 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1055 - val_loss: 0.1322 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0957 - val_loss: 0.1355 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0911 - val_loss: 0.1320 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0894 - val_loss: 0.1278 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0864 - val_loss: 0.1268 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0839 - val_loss: 0.1208 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.1318 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0756 - val_loss: 0.1238 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0751 - val_loss: 0.1217 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0696 - val_loss: 0.1257 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.1209 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.1220 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.1259 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.1223 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0659 - val_loss: 0.1218 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.1261 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.1235 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.1229 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.1246 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.1263 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.1260 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0658 - val_loss: 0.1257 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0655 - val_loss: 0.1260 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.1260 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.1264 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.1263 - lr: 6.0967e-06
Epoch 1/100
2023-11-26 16:29:58.985200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:58.985624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:58.986133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:59.038130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:59.038488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:59.038848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:59.115147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:59.115662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:59.116104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:59.174857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:59.175311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:59.175738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:59.355401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:59.355866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:59.356494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:59.413241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:59.413683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:59.414017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1891 - val_loss: 0.1284 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1171
2023-11-26 16:29:59.891040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:59.891467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:59.892146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:29:59.953536: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:29:59.954013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:29:59.954405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1639 - val_loss: 0.1180 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1541 - val_loss: 0.1064 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1467 - val_loss: 0.1001 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1357 - val_loss: 0.1224 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1318 - val_loss: 0.0837 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1330 - val_loss: 0.1004 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1213 - val_loss: 0.0795 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1216 - val_loss: 0.0785 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1175 - val_loss: 0.1297 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1033 - val_loss: 0.1161 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1080 - val_loss: 0.0738 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1047 - val_loss: 0.0987 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1007 - val_loss: 0.0772 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0982 - val_loss: 0.0759 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0919 - val_loss: 0.0876 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0875 - val_loss: 0.0761 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0845 - val_loss: 0.0796 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0811 - val_loss: 0.0768 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0783 - val_loss: 0.0761 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0743 - val_loss: 0.0741 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0732 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0693 - val_loss: 0.0723 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0733 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0738 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0666 - val_loss: 0.0738 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0664 - val_loss: 0.0738 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0652 - val_loss: 0.0749 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0657 - val_loss: 0.0735 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0653 - val_loss: 0.0744 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0756 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0753 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0747 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0643 - val_loss: 0.0745 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0647 - val_loss: 0.0748 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0639 - val_loss: 0.0750 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0651 - val_loss: 0.0750 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0638 - val_loss: 0.0750 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0643 - val_loss: 0.0749 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0639 - val_loss: 0.0750 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0750 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0750 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0750 - lr: 7.4659e-07
Epoch 1/100
2023-11-26 16:30:03.711968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:03.712428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:03.712762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:03.766294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:03.766664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:03.767001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:03.849678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:03.850164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:03.850577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:03.914215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:03.914852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:03.915299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:04.147811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:04.148489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:04.148936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:04.207837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:04.208325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:04.208748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 8ms/step - loss: 0.1814 - val_loss: 0.1666 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1246
2023-11-26 16:30:04.906302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:04.906782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:04.907204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:04.968373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:04.968741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:04.969169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1498 - val_loss: 0.1391 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1340 - val_loss: 0.1258 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1245 - val_loss: 0.1202 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1211 - val_loss: 0.1199 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1189 - val_loss: 0.1182 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1115 - val_loss: 0.1104 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1110 - val_loss: 0.1141 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1058 - val_loss: 0.1067 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0994 - val_loss: 0.1010 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0960 - val_loss: 0.0966 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0897 - val_loss: 0.0906 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0848 - val_loss: 0.0878 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0807 - val_loss: 0.0824 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0749 - val_loss: 0.0737 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0701 - val_loss: 0.0753 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0716 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0725 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0684 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0711 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0703 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0682 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0684 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0641 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0619 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0603 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0602 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0604 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0604 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0604 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0602 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0602 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0604 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0603 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0604 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0604 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0604 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0604 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0603 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0603 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0603 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0603 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0603 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0603 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0603 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0603 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0603 - lr: 1.5073e-07
Epoch 1/100
2023-11-26 16:30:11.996939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:11.997320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:11.997667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:12.049817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:12.050145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:12.050492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:12.131137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:12.131606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:12.132025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:12.190914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:12.191366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:12.191796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:12.424270: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:12.424723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:12.425282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:12.483447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:12.483928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:12.484401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1721 - val_loss: 0.1503 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1493
2023-11-26 16:30:13.236431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:13.236943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:13.237353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:13.298522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:13.298972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:13.299345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1457 - val_loss: 0.1468 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1345 - val_loss: 0.1300 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1225 - val_loss: 0.1260 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1187 - val_loss: 0.1185 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1104 - val_loss: 0.1067 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.1039 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0991 - val_loss: 0.0992 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0954 - val_loss: 0.0918 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0887 - val_loss: 0.0939 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0869 - val_loss: 0.0853 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0832 - val_loss: 0.0855 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0805 - val_loss: 0.0826 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0833 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0816 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0784 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0731 - val_loss: 0.0790 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0713 - val_loss: 0.0784 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0805 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0804 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0802 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0768 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0736 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0748 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0724 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0692 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0675 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0653 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0645 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0639 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0634 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0629 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0627 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0626 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0624 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0624 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0623 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0623 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0622 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0622 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0622 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0622 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0622 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0622 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0622 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0622 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0622 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0622 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0622 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0622 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0622 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0622 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0622 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0622 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0622 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0622 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0622 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0622 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0622 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0622 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0622 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0622 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0622 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0622 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0622 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0622 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0622 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0622 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0622 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0622 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0622 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0622 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0622 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0622 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0622 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0622 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0622 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0622 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0622 - lr: 1.3924e-15
Epoch 1/100
2023-11-26 16:30:28.681743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:28.682127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:28.682489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:28.733637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:28.734014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:28.734347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:28.814235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:28.814724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:28.815283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:28.874665: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:28.875123: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:28.875544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:29.125183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:29.125654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:29.126086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:29.184807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:29.185295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:29.185714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1607 - val_loss: 0.1358 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1066
2023-11-26 16:30:29.982930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:29.983403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:29.983930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:30.044787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:30.045195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:30.045566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1373 - val_loss: 0.1203 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1253 - val_loss: 0.1121 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1145 - val_loss: 0.1083 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1038 - val_loss: 0.1011 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0974 - val_loss: 0.0963 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.0912 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0852 - val_loss: 0.0869 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0946 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0749 - val_loss: 0.0839 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0731 - val_loss: 0.0761 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0714 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0722 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0693 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0682 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0669 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0654 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0647 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0636 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0637 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0624 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0621 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0609 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0603 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0600 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0598 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0594 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0592 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0593 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0588 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0587 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0584 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0584 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0583 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0583 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0582 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0582 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0582 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0582 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0582 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0582 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0582 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0582 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0582 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0582 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0582 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0582 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0582 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0582 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0582 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0582 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0582 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0582 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0582 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0582 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0582 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0582 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0582 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0582 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0582 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0582 - lr: 1.6788e-10
Average Validation Loss: 0.07472659945487976
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 16:30:44.654221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:44.654587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:44.655028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:44.708353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:44.708763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:44.709112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:44.788991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:44.789454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:44.789882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:45.244455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:45.244963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:45.245713: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:45.483040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:45.483495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:45.484056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:45.542010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:45.542452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:45.542868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 2s 37ms/step - loss: 0.1657 - val_loss: 0.1770 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1131
2023-11-26 16:30:46.136617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:46.137488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:46.138009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:46.202657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:46.203145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:46.203577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1556 - val_loss: 0.1808 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1560 - val_loss: 0.1750 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1524 - val_loss: 0.1654 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1435 - val_loss: 0.1610 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1387 - val_loss: 0.1591 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1329 - val_loss: 0.1550 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1249 - val_loss: 0.1484 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1154 - val_loss: 0.1397 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1028 - val_loss: 0.1393 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0956 - val_loss: 0.1244 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0924 - val_loss: 0.1324 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0923 - val_loss: 0.1301 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.1215 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1255 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.1216 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1290 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.1211 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1253 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1143 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1252 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.1220 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.1197 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.1211 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.1200 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1217 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.1217 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.1205 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.1197 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.1183 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.1182 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.1183 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.1182 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.1180 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.1181 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.1182 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.1183 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.1182 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.1181 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.1181 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:30:48.052092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:48.052566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:48.053193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:48.109189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:48.109609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:48.109984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:48.189363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:48.189864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:48.190431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:48.253240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:48.253729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:48.254410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:48.433768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:48.434242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:48.434595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:48.494095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:48.494664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:48.495323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 18ms/step - loss: 0.1876 - val_loss: 0.1298 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1105
2023-11-26 16:30:48.983958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:48.984671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:48.985181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:49.046679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:49.047102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:49.047487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 3ms/step - loss: 0.1676 - val_loss: 0.1253 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1593 - val_loss: 0.1181 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1513 - val_loss: 0.1126 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1474 - val_loss: 0.1101 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1392 - val_loss: 0.1098 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1339 - val_loss: 0.1105 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1279 - val_loss: 0.1150 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1224 - val_loss: 0.1084 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1189 - val_loss: 0.1061 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1113 - val_loss: 0.1096 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1056 - val_loss: 0.1105 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1027 - val_loss: 0.1036 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0978 - val_loss: 0.1035 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0967 - val_loss: 0.1025 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0929 - val_loss: 0.0997 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0913 - val_loss: 0.0968 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0887 - val_loss: 0.0947 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0883 - val_loss: 0.0965 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0863 - val_loss: 0.0951 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0861 - val_loss: 0.0908 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0840 - val_loss: 0.0940 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0829 - val_loss: 0.0930 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.0891 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0890 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0821 - val_loss: 0.0897 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0821 - val_loss: 0.0914 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0818 - val_loss: 0.0882 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0808 - val_loss: 0.0897 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0908 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0797 - val_loss: 0.0901 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0814 - val_loss: 0.0897 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0805 - val_loss: 0.0900 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0897 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0801 - val_loss: 0.0898 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0815 - val_loss: 0.0897 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0786 - val_loss: 0.0897 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0806 - val_loss: 0.0898 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0814 - val_loss: 0.0897 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0789 - val_loss: 0.0898 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0783 - val_loss: 0.0898 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0898 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0801 - val_loss: 0.0897 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0808 - val_loss: 0.0897 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0809 - val_loss: 0.0897 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0897 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0790 - val_loss: 0.0897 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0796 - val_loss: 0.0897 - lr: 1.0104e-07
Epoch 1/100
2023-11-26 16:30:51.774718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:51.775094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:51.775503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:51.827370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:51.827772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:51.828117: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:51.907465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:51.907968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:51.908591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:51.969520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:51.970003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:51.970425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:52.202933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:52.203562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:52.203991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:52.261393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:52.261846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:52.262261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 14ms/step - loss: 0.1608 - val_loss: 0.1548 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1077
2023-11-26 16:30:52.907039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:52.907504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:52.908205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:52.971201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:52.971842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:52.972287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.1444 - val_loss: 0.1407 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1359 - val_loss: 0.1301 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1290 - val_loss: 0.1217 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1222 - val_loss: 0.1148 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1146 - val_loss: 0.1094 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1085 - val_loss: 0.1062 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1038 - val_loss: 0.1011 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0969 - val_loss: 0.0976 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0931 - val_loss: 0.0896 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0891 - val_loss: 0.0889 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0884 - val_loss: 0.0903 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0905 - val_loss: 0.0928 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0916 - val_loss: 0.0835 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0862 - val_loss: 0.0805 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0831 - val_loss: 0.0768 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0830 - val_loss: 0.0746 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0824 - val_loss: 0.0729 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0767 - val_loss: 0.0710 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0738 - val_loss: 0.0700 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0695 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0692 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.0692 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.0691 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0689 - val_loss: 0.0696 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0693 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0696 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0689 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0694 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0693 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0689 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0689 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0665 - val_loss: 0.0686 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.0685 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0684 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0683 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0683 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.0683 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0683 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.0683 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0683 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0683 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0683 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0683 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0683 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0683 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0683 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.0683 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0683 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0661 - val_loss: 0.0683 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0683 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0683 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0683 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0683 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0683 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0683 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0683 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.0683 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0683 - lr: 5.0435e-10
Epoch 1/100
2023-11-26 16:30:58.604954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:58.605357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:58.605790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:58.656490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:58.656857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:58.657202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:58.742749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:58.743268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:58.743686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:58.804539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:58.804959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:58.805405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:59.044847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:59.045333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:59.045894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:59.104341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:59.104786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:59.105195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.1703 - val_loss: 0.1454 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1008
2023-11-26 16:30:59.765485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:59.765948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:59.766576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:30:59.827680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:30:59.828134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:30:59.828592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.1436 - val_loss: 0.1458 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1336 - val_loss: 0.1322 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1211 - val_loss: 0.1188 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1110 - val_loss: 0.1121 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1054 - val_loss: 0.1036 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0985 - val_loss: 0.1054 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0958 - val_loss: 0.1066 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0928 - val_loss: 0.0943 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0916 - val_loss: 0.1039 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0875 - val_loss: 0.0949 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0866 - val_loss: 0.1018 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0849 - val_loss: 0.1000 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0993 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0839 - val_loss: 0.1103 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0829 - val_loss: 0.1138 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0888 - val_loss: 0.1227 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0992 - val_loss: 0.0997 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0914 - val_loss: 0.0860 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.0873 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0852 - val_loss: 0.0795 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0837 - val_loss: 0.0729 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0721 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0718 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0710 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0708 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0748 - val_loss: 0.0707 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0732 - val_loss: 0.0706 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0703 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0728 - val_loss: 0.0702 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0732 - val_loss: 0.0703 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0728 - val_loss: 0.0702 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0702 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0728 - val_loss: 0.0702 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0701 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0701 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.0701 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.0701 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.0701 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0722 - val_loss: 0.0701 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0701 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0700 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0700 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.0700 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0713 - val_loss: 0.0700 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0722 - val_loss: 0.0700 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0700 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0700 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0700 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.0700 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0700 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0700 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0700 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0700 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.0700 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0700 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.0700 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0720 - val_loss: 0.0700 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0700 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.0700 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0700 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.0700 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0700 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0722 - val_loss: 0.0700 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0700 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0700 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0700 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0729 - val_loss: 0.0700 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0700 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0700 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0700 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0722 - val_loss: 0.0700 - lr: 1.8698e-13
Epoch 1/100
2023-11-26 16:31:08.410971: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:08.411373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:08.411949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:08.462902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:08.463277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:08.463633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:08.548447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:08.548873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:08.549426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:08.612124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:08.612772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:08.613451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:08.850653: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:08.851161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:08.851603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:08.909985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:08.910445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:08.910867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 9ms/step - loss: 0.1623 - val_loss: 0.1487 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0991
2023-11-26 16:31:09.595827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:09.596310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:09.596945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:09.657940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:09.658375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:09.658765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.1408 - val_loss: 0.1403 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1261 - val_loss: 0.1330 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1161 - val_loss: 0.1270 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1068 - val_loss: 0.1230 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1035 - val_loss: 0.1191 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0981 - val_loss: 0.1155 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0955 - val_loss: 0.1133 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0924 - val_loss: 0.1105 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0893 - val_loss: 0.1073 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.1032 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0848 - val_loss: 0.1011 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0806 - val_loss: 0.0979 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0783 - val_loss: 0.0965 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0766 - val_loss: 0.0920 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0734 - val_loss: 0.0892 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0872 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0859 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0831 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0809 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0787 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0778 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0777 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0765 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0768 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0760 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0750 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0736 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0730 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0720 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0718 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0715 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0713 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0712 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0711 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0710 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0710 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0711 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0710 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0710 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0710 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0710 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0710 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0710 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0710 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0710 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0710 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0710 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0710 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0710 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0710 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0710 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0710 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0710 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0710 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0710 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0710 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0710 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0710 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0710 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0710 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0710 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0710 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0710 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0710 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0710 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0710 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0710 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0710 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0710 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0710 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0710 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0710 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0710 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0710 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0710 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0710 - lr: 2.8039e-15
Average Validation Loss: 0.08237514793872833
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 16:31:20.915087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:20.915750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:20.916093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:20.968659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:20.969015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:20.969377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:21.051014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:21.051508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:21.051918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:21.112128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:21.112602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:21.113011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:21.346848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:21.347329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:21.347872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:21.405088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:21.405544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:21.405983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
1/5 [=====>........................] - ETA: 3s - loss: 0.1762
2023-11-26 16:31:21.967300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:21.967715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:21.968227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 2s 160ms/step - loss: 0.2138 - val_loss: 0.1904 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1653 - val_loss: 0.1824 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1600 - val_loss: 0.1875 - lr: 0.0010
Epoch 4/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1749
2023-11-26 16:31:22.406183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:22.406680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:22.407271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 7ms/step - loss: 0.1612 - val_loss: 0.1903 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1597 - val_loss: 0.1878 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1600 - val_loss: 0.1819 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1560 - val_loss: 0.1762 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1532 - val_loss: 0.1717 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1508 - val_loss: 0.1688 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1423 - val_loss: 0.1664 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1429 - val_loss: 0.1652 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1401 - val_loss: 0.1650 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1358 - val_loss: 0.1646 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1353 - val_loss: 0.1637 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1322 - val_loss: 0.1620 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1320 - val_loss: 0.1607 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1298 - val_loss: 0.1595 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1299 - val_loss: 0.1579 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1273 - val_loss: 0.1569 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1243 - val_loss: 0.1560 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1241 - val_loss: 0.1548 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1205 - val_loss: 0.1539 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1216 - val_loss: 0.1532 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1181 - val_loss: 0.1526 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1170 - val_loss: 0.1517 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1147 - val_loss: 0.1510 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1184 - val_loss: 0.1506 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1168 - val_loss: 0.1502 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1130 - val_loss: 0.1499 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1155 - val_loss: 0.1496 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1147 - val_loss: 0.1496 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1168 - val_loss: 0.1496 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1125 - val_loss: 0.1495 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1159 - val_loss: 0.1495 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1152 - val_loss: 0.1495 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1138 - val_loss: 0.1494 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1119 - val_loss: 0.1494 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1145 - val_loss: 0.1494 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1147 - val_loss: 0.1494 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1154 - val_loss: 0.1494 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1117 - val_loss: 0.1494 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1146 - val_loss: 0.1494 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1147 - val_loss: 0.1494 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1147 - val_loss: 0.1494 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1150 - val_loss: 0.1494 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1124 - val_loss: 0.1494 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1112 - val_loss: 0.1494 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1139 - val_loss: 0.1494 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1149 - val_loss: 0.1494 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1138 - val_loss: 0.1494 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1149 - val_loss: 0.1494 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1132 - val_loss: 0.1494 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1118 - val_loss: 0.1494 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1138 - val_loss: 0.1494 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1118 - val_loss: 0.1494 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1153 - val_loss: 0.1494 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1106 - val_loss: 0.1494 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1154 - val_loss: 0.1494 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1158 - val_loss: 0.1494 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1107 - val_loss: 0.1494 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1148 - val_loss: 0.1494 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1123 - val_loss: 0.1494 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1114 - val_loss: 0.1494 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1138 - val_loss: 0.1494 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1132 - val_loss: 0.1494 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1138 - val_loss: 0.1494 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1132 - val_loss: 0.1494 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1132 - val_loss: 0.1494 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1149 - val_loss: 0.1494 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1159 - val_loss: 0.1494 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1153 - val_loss: 0.1494 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1138 - val_loss: 0.1494 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1133 - val_loss: 0.1494 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1138 - val_loss: 0.1494 - lr: 4.6110e-14
Epoch 1/100
2023-11-26 16:31:24.993096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:24.993460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:24.993930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:25.045416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:25.045798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:25.046136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:25.127470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:25.127935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:25.128352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:25.188385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:25.188849: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:25.189256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:25.420523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:25.420996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:25.421506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:25.478998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:25.479439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:25.479852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1825 - val_loss: 0.1295 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1633
2023-11-26 16:31:26.078317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:26.078796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:26.079332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:26.140541: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:26.140985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:26.141372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1734 - val_loss: 0.1250 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1633 - val_loss: 0.1276 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1608 - val_loss: 0.1248 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1550 - val_loss: 0.1175 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1488 - val_loss: 0.1116 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1446 - val_loss: 0.1109 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1366 - val_loss: 0.1101 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1315 - val_loss: 0.1056 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1269 - val_loss: 0.1083 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1215 - val_loss: 0.1031 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1200 - val_loss: 0.1029 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1116 - val_loss: 0.1089 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1093 - val_loss: 0.1032 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1057 - val_loss: 0.1092 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1027 - val_loss: 0.1096 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1015 - val_loss: 0.1021 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0981 - val_loss: 0.1063 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0965 - val_loss: 0.1014 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0957 - val_loss: 0.1055 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.1039 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.1038 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0939 - val_loss: 0.1033 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0925 - val_loss: 0.1017 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.1008 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0917 - val_loss: 0.1047 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0906 - val_loss: 0.1042 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0915 - val_loss: 0.1013 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0907 - val_loss: 0.1012 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.1015 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.1006 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0901 - val_loss: 0.1003 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0896 - val_loss: 0.1005 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0899 - val_loss: 0.1007 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.1009 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0905 - val_loss: 0.1010 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0895 - val_loss: 0.1010 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0890 - val_loss: 0.1010 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0908 - val_loss: 0.1010 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0878 - val_loss: 0.1010 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.1010 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.1010 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0901 - val_loss: 0.1010 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.1010 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0889 - val_loss: 0.1010 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.1010 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.1010 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0897 - val_loss: 0.1010 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.1010 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0910 - val_loss: 0.1010 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.1010 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0898 - val_loss: 0.1010 - lr: 1.6702e-08
Epoch 1/100
2023-11-26 16:31:28.802087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:28.802582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:28.803003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:28.856072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:28.856454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:28.856815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:28.937425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:28.937915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:28.938290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:28.998914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:28.999438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:28.999824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:29.231683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:29.232135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:29.232581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:29.290600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:29.291051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:29.291489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 25ms/step - loss: 0.2011 - val_loss: 0.1762 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1623
2023-11-26 16:31:29.887896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:29.888336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:29.888952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:29.950073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:29.950491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:29.950885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1635 - val_loss: 0.1680 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1548 - val_loss: 0.1676 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1448 - val_loss: 0.1549 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1372 - val_loss: 0.1472 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1333 - val_loss: 0.1414 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1291 - val_loss: 0.1361 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1252 - val_loss: 0.1289 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1219 - val_loss: 0.1262 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1174 - val_loss: 0.1194 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1151 - val_loss: 0.1168 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1113 - val_loss: 0.1119 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1073 - val_loss: 0.1121 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1042 - val_loss: 0.1062 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1049 - val_loss: 0.1054 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0999 - val_loss: 0.1027 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0990 - val_loss: 0.1011 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0966 - val_loss: 0.0988 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0968 - val_loss: 0.0993 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0964 - val_loss: 0.1009 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.0966 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0944 - val_loss: 0.0992 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.0974 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0988 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.0978 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0912 - val_loss: 0.0973 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.0982 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.0970 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0968 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0899 - val_loss: 0.0975 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.0971 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.0969 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.0969 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0899 - val_loss: 0.0971 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0972 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0971 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0894 - val_loss: 0.0971 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.0970 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.0970 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0893 - val_loss: 0.0970 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0901 - val_loss: 0.0970 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:31:32.689392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:32.689802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:32.690304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:32.740571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:32.740946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:32.741276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:32.822195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:32.822674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:32.823093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:32.881987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:32.882377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:32.882809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:33.123008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:33.123464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:33.123901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:33.182076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:33.182527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:33.182943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 20ms/step - loss: 0.1771 - val_loss: 0.1579 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1852
2023-11-26 16:31:33.790073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:33.790555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:33.791140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:33.853004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:33.853460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:33.853840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1597 - val_loss: 0.1410 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1390 - val_loss: 0.1455 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1309 - val_loss: 0.1539 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1284 - val_loss: 0.1482 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1266 - val_loss: 0.1334 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1178 - val_loss: 0.1334 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1141 - val_loss: 0.1360 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1127 - val_loss: 0.1255 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1078 - val_loss: 0.1254 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1055 - val_loss: 0.1253 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1052 - val_loss: 0.1115 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0986 - val_loss: 0.1178 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0987 - val_loss: 0.1094 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0970 - val_loss: 0.1063 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.1057 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.1063 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.1023 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.1019 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0884 - val_loss: 0.0983 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.0986 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0962 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0866 - val_loss: 0.0967 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0954 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0947 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0935 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0929 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0941 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.0939 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0940 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0933 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0924 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.0920 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0921 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0921 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0921 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.0921 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0920 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.0919 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0919 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.0919 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0919 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.0919 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0919 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.0919 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0919 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.0919 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0919 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0919 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.0919 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0919 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0919 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0919 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0919 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0919 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.0919 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0919 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0919 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.0919 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.0919 - lr: 3.0590e-10
Epoch 1/100
2023-11-26 16:31:38.821012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:38.821421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:38.821995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:38.872543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:38.872902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:38.873239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:38.953272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:38.953750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:38.954167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:39.014043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:39.014494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:39.014899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:39.246991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:39.247449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:39.247977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:39.305425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:39.305870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:39.306304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 16ms/step - loss: 0.1936 - val_loss: 0.1569 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1817
2023-11-26 16:31:39.937147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:39.937662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:39.938344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:40.000553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:40.000981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:40.001390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 5ms/step - loss: 0.1679 - val_loss: 0.1483 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1521 - val_loss: 0.1429 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1373 - val_loss: 0.1383 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1326 - val_loss: 0.1386 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1285 - val_loss: 0.1319 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1210 - val_loss: 0.1265 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1166 - val_loss: 0.1260 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1151 - val_loss: 0.1253 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1136 - val_loss: 0.1226 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1081 - val_loss: 0.1160 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1022 - val_loss: 0.1143 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0993 - val_loss: 0.1133 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0970 - val_loss: 0.1104 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0938 - val_loss: 0.1088 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0893 - val_loss: 0.1033 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0865 - val_loss: 0.1019 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0860 - val_loss: 0.1019 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.1013 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.0973 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0915 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0861 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0752 - val_loss: 0.0835 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.0808 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0788 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0780 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0773 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0774 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0765 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0763 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0762 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0762 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0760 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0759 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0759 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0758 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0693 - val_loss: 0.0757 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.0757 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0692 - val_loss: 0.0757 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0757 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0757 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0757 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0757 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0700 - val_loss: 0.0757 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0757 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0757 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0757 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0699 - val_loss: 0.0757 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.0757 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.0757 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.0757 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0757 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.0757 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0757 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0699 - val_loss: 0.0757 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0696 - val_loss: 0.0757 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.0757 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0757 - lr: 8.3153e-10
Average Validation Loss: 0.10276560187339782
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:31:45.781574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:45.781969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:45.782553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:45.834492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:45.834895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:45.835242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:45.914595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:45.915146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:45.915610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:45.976055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:45.976509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:45.976912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:46.209551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:46.210013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:46.210457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:46.268202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:46.268661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:46.269087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.1611 - val_loss: 0.1299 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0528
2023-11-26 16:31:46.871807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:46.872315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:46.872938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:46.934335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:46.934773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:46.935177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1117 - val_loss: 0.1293 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1085 - val_loss: 0.1242 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1048 - val_loss: 0.1237 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1040 - val_loss: 0.1229 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0991 - val_loss: 0.1213 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0951 - val_loss: 0.1189 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0833 - val_loss: 0.1249 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0807 - val_loss: 0.1228 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.1357 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0751 - val_loss: 0.1238 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.1126 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.1066 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.1174 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.1121 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.1126 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.1221 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.1008 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.1097 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.1015 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.1123 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.1028 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.1036 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.1037 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.1062 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.1018 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0416 - val_loss: 0.1105 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.1075 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.1044 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0423 - val_loss: 0.1054 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.1061 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.1061 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.1063 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.1049 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.1041 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.1035 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0414 - val_loss: 0.1037 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.1034 - lr: 4.5166e-06
Epoch 1/100
2023-11-26 16:31:49.536245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:49.536721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:49.537127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:49.589369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:49.589740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:49.590088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:49.666405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:49.666883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:49.667364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:49.727490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:49.727965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:49.728375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:49.906840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:49.907329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:49.907753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:49.966016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:49.966464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:49.966881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1304 - val_loss: 0.0757 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0812
2023-11-26 16:31:50.838220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:50.838704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:50.839354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:50.901650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:50.902126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:50.903254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1195 - val_loss: 0.0751 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1150 - val_loss: 0.0681 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1081 - val_loss: 0.0669 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1074 - val_loss: 0.0654 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0996 - val_loss: 0.0669 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1005 - val_loss: 0.0594 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0962 - val_loss: 0.0726 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0930 - val_loss: 0.0681 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0899 - val_loss: 0.0697 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0873 - val_loss: 0.0697 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0795 - val_loss: 0.0821 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0764 - val_loss: 0.0746 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.0725 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0713 - val_loss: 0.0705 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0659 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0667 - val_loss: 0.0647 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0618 - val_loss: 0.0670 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0609 - val_loss: 0.0679 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0578 - val_loss: 0.0663 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0556 - val_loss: 0.0635 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0553 - val_loss: 0.0609 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0532 - val_loss: 0.0655 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0516 - val_loss: 0.0631 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0508 - val_loss: 0.0630 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0502 - val_loss: 0.0622 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0500 - val_loss: 0.0655 - lr: 9.0718e-05
Epoch 1/100
2023-11-26 16:31:53.288754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:53.289235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:53.289640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:53.342085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:53.342461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:53.342803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:53.422141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:53.422668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:53.423026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:53.482857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:53.483298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:53.483705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:53.717471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:53.717923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:53.718383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:53.775837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:53.776307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:53.776733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 8ms/step - loss: 0.1103 - val_loss: 0.1064 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0775
2023-11-26 16:31:54.476317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:54.476745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:54.477367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:31:54.537747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:31:54.538218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:31:54.538596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1062 - val_loss: 0.0983 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1015 - val_loss: 0.0904 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0973 - val_loss: 0.0892 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0979 - val_loss: 0.0873 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0898 - val_loss: 0.0843 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0860 - val_loss: 0.0834 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0831 - val_loss: 0.0799 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0803 - val_loss: 0.0743 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0794 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0729 - val_loss: 0.0684 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0674 - val_loss: 0.0681 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0603 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0601 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0611 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0551 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0550 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0545 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0539 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0523 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0511 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0506 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0488 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0485 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0494 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0499 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0516 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0458 - val_loss: 0.0520 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0512 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0518 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0513 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0511 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0507 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0510 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0510 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0510 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0509 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0509 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0509 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0509 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0509 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0508 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0508 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0508 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:32:01.142718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:01.143179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:01.143631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:01.196391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:01.196773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:01.197119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:01.275291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:01.275770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:01.276191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:01.335534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:01.335990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:01.336402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:01.568738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:01.569295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:01.569798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:01.627233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:01.627688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:01.628101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1149 - val_loss: 0.1051 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.0946
2023-11-26 16:32:02.377600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:02.378092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:02.378768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:02.441261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:02.441719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:02.442116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1040 - val_loss: 0.1015 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1023 - val_loss: 0.0971 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0957 - val_loss: 0.0882 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0899 - val_loss: 0.0856 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0832 - val_loss: 0.0792 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0798 - val_loss: 0.0774 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0765 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0750 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0737 - val_loss: 0.0739 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0760 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0661 - val_loss: 0.0727 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0682 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0684 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0678 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0619 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0618 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0596 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0635 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0596 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0603 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0604 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0606 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0613 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0574 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0529 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0511 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0500 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0489 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0487 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0482 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0480 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0479 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0478 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0477 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0477 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0477 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0476 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0476 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0476 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0476 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0476 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0476 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0476 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0476 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0476 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0476 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0476 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0476 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0476 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0476 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0476 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0476 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0476 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0476 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0476 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0476 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0476 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0476 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0476 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0476 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0476 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0476 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0476 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0476 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0476 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0476 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0476 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0476 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0476 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0476 - lr: 6.9144e-16
Epoch 1/100
2023-11-26 16:32:17.990893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:17.991330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:17.991912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:18.042928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:18.043335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:18.043683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:18.124222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:18.124681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:18.125103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:18.183868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:18.184338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:18.184751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:18.420714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:18.421251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:18.421803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:18.480242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:18.480702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:18.481064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1179 - val_loss: 0.1005 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0580
2023-11-26 16:32:19.279047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:19.279545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:19.280177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:19.341236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:19.341706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:19.342141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1076 - val_loss: 0.0958 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1003 - val_loss: 0.0927 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0944 - val_loss: 0.0917 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0890 - val_loss: 0.0892 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0873 - val_loss: 0.0882 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0814 - val_loss: 0.0853 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0826 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0811 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0804 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0779 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0747 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0685 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0685 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0673 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0648 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0647 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0631 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0622 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0618 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0605 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0458 - val_loss: 0.0594 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0584 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0583 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0577 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0575 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0574 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0574 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0572 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0575 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0570 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0568 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0403 - val_loss: 0.0565 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0407 - val_loss: 0.0565 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0407 - val_loss: 0.0564 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0400 - val_loss: 0.0562 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0405 - val_loss: 0.0563 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0402 - val_loss: 0.0563 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0406 - val_loss: 0.0562 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0396 - val_loss: 0.0562 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0398 - val_loss: 0.0562 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0402 - val_loss: 0.0563 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0563 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0404 - val_loss: 0.0563 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0397 - val_loss: 0.0563 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0405 - val_loss: 0.0563 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0402 - val_loss: 0.0563 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0563 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0399 - val_loss: 0.0562 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0406 - val_loss: 0.0562 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0401 - val_loss: 0.0562 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0401 - val_loss: 0.0562 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0404 - val_loss: 0.0562 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0407 - val_loss: 0.0562 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0405 - val_loss: 0.0562 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0404 - val_loss: 0.0562 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0397 - val_loss: 0.0562 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0396 - val_loss: 0.0562 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0401 - val_loss: 0.0562 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0406 - val_loss: 0.0562 - lr: 3.0590e-10
Average Validation Loss: 0.06250347271561622
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
2023-11-26 16:32:33.635549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:33.635926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:33.636396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:33.688621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:33.689027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:33.689365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:33.769317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:33.769797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:33.770207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:33.829631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:33.830013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:33.830421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:34.064990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:34.065453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:34.065876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:34.123805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:34.124271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:34.124676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1354 - val_loss: 0.1407 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0657
2023-11-26 16:32:34.708901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:34.709399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:34.709878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:34.770413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:34.770830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:34.771213: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 5ms/step - loss: 0.1129 - val_loss: 0.1458 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1166 - val_loss: 0.1374 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1087 - val_loss: 0.1252 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1013 - val_loss: 0.1182 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0917 - val_loss: 0.1191 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.1134 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.1068 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.1114 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.1009 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0652 - val_loss: 0.1056 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0646 - val_loss: 0.1028 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.1064 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.1008 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.1049 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.1002 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.1030 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0988 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.1023 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0975 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.1011 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0983 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0977 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0995 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0992 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0967 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0972 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0993 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0987 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0981 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0976 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0977 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0977 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0977 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0457 - val_loss: 0.0977 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0978 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0979 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0980 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0980 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.0980 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0472 - val_loss: 0.0980 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0980 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0980 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0980 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0980 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0980 - lr: 2.2487e-07
Epoch 1/100
2023-11-26 16:32:36.918638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:36.919121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:36.919537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:36.971935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:36.972320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:36.972661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:37.050088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:37.050577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:37.051001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:37.110365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:37.110806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:37.111209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:37.290713: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:37.291172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:37.291707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:37.348700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:37.349153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:37.349576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 18ms/step - loss: 0.1374 - val_loss: 0.0838 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0793
2023-11-26 16:32:37.810040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:37.810529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:37.811167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:37.871611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:37.872046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:37.872425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 3ms/step - loss: 0.1256 - val_loss: 0.0844 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1203 - val_loss: 0.0811 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1157 - val_loss: 0.0754 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1104 - val_loss: 0.0767 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1060 - val_loss: 0.0722 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1036 - val_loss: 0.0756 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0959 - val_loss: 0.0719 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0976 - val_loss: 0.0745 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0885 - val_loss: 0.0714 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0840 - val_loss: 0.0681 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0793 - val_loss: 0.0677 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0625 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0653 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0674 - val_loss: 0.0788 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0782 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0700 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0666 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0691 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0712 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0685 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0712 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0684 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0703 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0688 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0693 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0687 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0709 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0696 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0696 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0705 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0704 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0699 - lr: 2.0242e-05
Epoch 1/100
2023-11-26 16:32:39.772281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:39.772697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:39.773277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:39.826763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:39.827165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:39.827519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:39.908046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:39.908535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:39.909087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:39.971633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:39.972224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:39.972757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:40.628717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:40.629391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:40.629822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:40.688621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:40.689075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:40.689519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 2s 14ms/step - loss: 0.1331 - val_loss: 0.1235 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0662
2023-11-26 16:32:41.336964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:41.337466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:41.338135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:41.398699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:41.399132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:41.399581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.1074 - val_loss: 0.1084 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0998 - val_loss: 0.0937 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0945 - val_loss: 0.0863 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0908 - val_loss: 0.0832 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0867 - val_loss: 0.0784 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0831 - val_loss: 0.0728 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0780 - val_loss: 0.0686 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0752 - val_loss: 0.0666 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0734 - val_loss: 0.0598 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0634 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0563 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0658 - val_loss: 0.0551 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0546 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0532 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0620 - val_loss: 0.0532 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0631 - val_loss: 0.0523 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.0556 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0657 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.0692 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0700 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0639 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0627 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0603 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0603 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0541 - val_loss: 0.0598 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0544 - val_loss: 0.0589 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0533 - val_loss: 0.0582 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0594 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0530 - val_loss: 0.0593 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0587 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0546 - val_loss: 0.0585 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0585 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0586 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0525 - val_loss: 0.0586 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0585 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0529 - val_loss: 0.0586 - lr: 6.0967e-06
Epoch 1/100
2023-11-26 16:32:44.943678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:44.944105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:44.944564: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:44.996146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:44.996572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:44.996909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:45.076187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:45.076678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:45.077098: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:45.137376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:45.137851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:45.138256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:45.369972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:45.370415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:45.370843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:45.428320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:45.428777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:45.429188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.1432 - val_loss: 0.1113 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0835
2023-11-26 16:32:46.098979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:46.099651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:46.100279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:46.162379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:46.162803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:46.163181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.1076 - val_loss: 0.1061 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1007 - val_loss: 0.1036 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0942 - val_loss: 0.1064 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0902 - val_loss: 0.0952 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0836 - val_loss: 0.0919 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.0756 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.0654 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.0716 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0661 - val_loss: 0.0640 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0676 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0633 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0630 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0638 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0790 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0574 - val_loss: 0.0723 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0803 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0856 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0963 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0960 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0663 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0607 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0560 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0506 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0472 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0468 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0453 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0441 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0433 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0441 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0435 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0438 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0436 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0435 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0432 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0430 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0429 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0430 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0430 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0430 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0431 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0431 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0431 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0431 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0431 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0431 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0431 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0431 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0431 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0431 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0431 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0431 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0431 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0431 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0431 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0431 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0431 - lr: 1.3710e-09
Epoch 1/100
2023-11-26 16:32:52.904122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:52.904537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:52.905084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:52.957121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:52.957484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:52.957827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:53.036781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:53.037260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:53.037676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:53.097944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:53.098420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:53.098808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:53.330717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:53.331178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:53.331721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:53.389627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:53.390092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:53.390501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 10ms/step - loss: 0.1258 - val_loss: 0.1076 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0723
2023-11-26 16:32:54.085272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:54.085773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:54.086256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:32:54.146769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:32:54.147210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:32:54.147598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.1118 - val_loss: 0.1046 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1027 - val_loss: 0.1014 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0973 - val_loss: 0.1007 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0902 - val_loss: 0.1019 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0870 - val_loss: 0.0998 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.1008 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0783 - val_loss: 0.1004 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0748 - val_loss: 0.1023 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0742 - val_loss: 0.0987 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.1030 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0981 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0987 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0960 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0929 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0923 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0917 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0904 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0896 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0883 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0873 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0865 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0859 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0853 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0849 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0843 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0840 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0835 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0832 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0831 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0829 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0828 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0827 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0827 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0826 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0826 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0826 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0826 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0826 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0826 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0826 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0826 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0826 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0826 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0826 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0826 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0826 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0826 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0826 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0826 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0826 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0826 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0826 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0826 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0826 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0826 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0826 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0826 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0826 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0826 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0826 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0826 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0826 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0826 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0826 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0826 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0826 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0826 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0826 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0826 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0826 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0826 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0826 - lr: 9.2853e-14
Average Validation Loss: 0.06741385459899903
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:33:04.610522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:04.610948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:04.611419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:04.662233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:04.662592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:04.662929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:04.742727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:04.743197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:04.743635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:04.802655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:04.803108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:04.803520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:05.034917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:05.035463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:05.035918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:05.093872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:05.094324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:05.094743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 66ms/step - loss: 0.2015 - val_loss: 0.1628 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0962
2023-11-26 16:33:05.652666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:05.653140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:05.653803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:05.715632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:05.716058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:05.716446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 8ms/step - loss: 0.1353 - val_loss: 0.1329 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1130 - val_loss: 0.1329 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1098 - val_loss: 0.1376 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1135 - val_loss: 0.1410 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1109 - val_loss: 0.1426 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1146 - val_loss: 0.1408 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1092 - val_loss: 0.1368 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1081 - val_loss: 0.1323 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1045 - val_loss: 0.1288 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1020 - val_loss: 0.1267 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1016 - val_loss: 0.1262 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0988 - val_loss: 0.1261 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0976 - val_loss: 0.1258 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0940 - val_loss: 0.1256 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0940 - val_loss: 0.1256 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0936 - val_loss: 0.1251 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0909 - val_loss: 0.1239 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0898 - val_loss: 0.1226 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0895 - val_loss: 0.1216 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0851 - val_loss: 0.1207 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0854 - val_loss: 0.1197 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0843 - val_loss: 0.1188 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0817 - val_loss: 0.1185 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0815 - val_loss: 0.1184 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0826 - val_loss: 0.1182 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0828 - val_loss: 0.1178 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0812 - val_loss: 0.1176 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0811 - val_loss: 0.1176 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0803 - val_loss: 0.1175 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0808 - val_loss: 0.1175 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0788 - val_loss: 0.1174 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0797 - val_loss: 0.1174 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0794 - val_loss: 0.1174 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0788 - val_loss: 0.1173 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0818 - val_loss: 0.1173 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0790 - val_loss: 0.1172 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0809 - val_loss: 0.1172 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0801 - val_loss: 0.1172 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0810 - val_loss: 0.1172 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0787 - val_loss: 0.1172 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0794 - val_loss: 0.1172 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0785 - val_loss: 0.1172 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0769 - val_loss: 0.1172 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0774 - val_loss: 0.1172 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0792 - val_loss: 0.1172 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0786 - val_loss: 0.1172 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0792 - val_loss: 0.1172 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0827 - val_loss: 0.1172 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0773 - val_loss: 0.1172 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0779 - val_loss: 0.1172 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0771 - val_loss: 0.1172 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0816 - val_loss: 0.1172 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.1172 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0776 - val_loss: 0.1172 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0787 - val_loss: 0.1172 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0787 - val_loss: 0.1172 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0813 - val_loss: 0.1172 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0778 - val_loss: 0.1172 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0802 - val_loss: 0.1172 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.1172 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0802 - val_loss: 0.1172 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0814 - val_loss: 0.1172 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0817 - val_loss: 0.1172 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0778 - val_loss: 0.1172 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0775 - val_loss: 0.1172 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0801 - val_loss: 0.1172 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0782 - val_loss: 0.1172 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0767 - val_loss: 0.1172 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0794 - val_loss: 0.1172 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0778 - val_loss: 0.1172 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0775 - val_loss: 0.1172 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0799 - val_loss: 0.1172 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0793 - val_loss: 0.1172 - lr: 4.6110e-14
Epoch 75/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0810 - val_loss: 0.1172 - lr: 2.2897e-14
Epoch 1/100
2023-11-26 16:33:08.280711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:08.281129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:08.281589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:08.331582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:08.331937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:08.332269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:08.415089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:08.415561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:08.416029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:08.475179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:08.475652: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:08.476065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:08.708789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:08.709259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:08.709682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:08.766931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:08.767401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:08.767819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1521 - val_loss: 0.1089 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0900
2023-11-26 16:33:09.365591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:09.366076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:09.366689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:09.428017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:09.428450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:09.428824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1263 - val_loss: 0.0843 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1211 - val_loss: 0.0799 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1181 - val_loss: 0.0828 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1114 - val_loss: 0.0796 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1085 - val_loss: 0.0771 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1060 - val_loss: 0.0790 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1000 - val_loss: 0.0757 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.0753 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0671 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0646 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0712 - val_loss: 0.0690 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0649 - val_loss: 0.0669 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0666 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0668 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0657 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0620 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0664 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0634 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0630 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0568 - val_loss: 0.0657 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0628 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0602 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0633 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0628 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0636 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0631 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0623 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0621 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0623 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0566 - val_loss: 0.0626 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0629 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0631 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0632 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0634 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0634 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0633 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0633 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0632 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0631 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0631 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0631 - lr: 7.4659e-07
Epoch 1/100
2023-11-26 16:33:11.589999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:11.590380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:11.590794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:11.643457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:11.643835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:11.644184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:11.723219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:11.723683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:11.724095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:11.783518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:11.783978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:11.784391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:12.017964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:12.018455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:12.018879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:12.078568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:12.079066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:12.079486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 25ms/step - loss: 0.1667 - val_loss: 0.1315 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1082
2023-11-26 16:33:12.679878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:12.680367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:12.681030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:12.741059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:12.741479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:12.741898: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1232 - val_loss: 0.1207 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1152 - val_loss: 0.1246 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1072 - val_loss: 0.1183 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1021 - val_loss: 0.1104 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1004 - val_loss: 0.1059 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0971 - val_loss: 0.0995 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0925 - val_loss: 0.0927 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0884 - val_loss: 0.0858 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0802 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.0786 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.0844 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0773 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0769 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0752 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0703 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0736 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0739 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0661 - val_loss: 0.0695 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0653 - val_loss: 0.0680 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0641 - val_loss: 0.0684 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0683 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0633 - val_loss: 0.0659 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0666 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0640 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0661 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0631 - val_loss: 0.0669 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0647 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0644 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0656 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0652 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0650 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0650 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0648 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0648 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0647 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0648 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0650 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0650 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0650 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0650 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0650 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0650 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0650 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0650 - lr: 3.3546e-07
Epoch 1/100
2023-11-26 16:33:15.701226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:15.701649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:15.702216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:15.754630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:15.754993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:15.755364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:15.836109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:15.836600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:15.837038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:16.290434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:16.290965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:16.291599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:16.523738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:16.524245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:16.524666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:16.582469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:16.582938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:16.583341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 2s 20ms/step - loss: 0.1879 - val_loss: 0.1242 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0917
2023-11-26 16:33:17.190705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:17.191206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:17.191847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:17.251715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:17.252130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:17.252510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1214 - val_loss: 0.1096 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1101 - val_loss: 0.0973 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0960 - val_loss: 0.1060 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0945 - val_loss: 0.1017 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0889 - val_loss: 0.0902 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0863 - val_loss: 0.0929 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0870 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.0841 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0876 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.0801 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0764 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0725 - val_loss: 0.0802 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0710 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0717 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0730 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0678 - val_loss: 0.0692 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0665 - val_loss: 0.0678 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0653 - val_loss: 0.0661 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0649 - val_loss: 0.0630 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0631 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0624 - val_loss: 0.0597 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0592 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0598 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0575 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0584 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0592 - val_loss: 0.0570 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0565 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0566 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0562 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0561 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0562 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0563 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0576 - val_loss: 0.0562 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0560 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0560 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0560 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0559 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0559 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0576 - val_loss: 0.0558 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0558 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0559 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0559 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0559 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0559 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0559 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0559 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0559 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0559 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0559 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0559 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0559 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0559 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0559 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0559 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0559 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0559 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0559 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0559 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0559 - lr: 3.0590e-10
Epoch 1/100
2023-11-26 16:33:22.150066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:22.150464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:22.151014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:22.201708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:22.202102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:22.202452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:22.282835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:22.283312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:22.283739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:22.343619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:22.344083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:22.344503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:22.575967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:22.576417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:22.576856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:22.634576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:22.635028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:22.635369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 16ms/step - loss: 0.1266 - val_loss: 0.1077 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1202
2023-11-26 16:33:23.258653: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:23.259132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:23.259605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:23.320550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:23.320968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:23.321355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 4ms/step - loss: 0.1107 - val_loss: 0.1061 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1024 - val_loss: 0.1050 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0979 - val_loss: 0.1028 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0949 - val_loss: 0.1018 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0928 - val_loss: 0.0997 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0898 - val_loss: 0.0976 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0841 - val_loss: 0.0935 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0823 - val_loss: 0.0920 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0808 - val_loss: 0.0903 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0788 - val_loss: 0.0898 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0757 - val_loss: 0.0885 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.0886 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.0870 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0850 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0794 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.0766 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0727 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0688 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0672 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0650 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0618 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0593 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0497 - val_loss: 0.0585 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0579 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0574 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0572 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0571 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0570 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0568 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0566 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0564 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0565 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0564 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0564 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0563 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0563 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0563 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0563 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0563 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0563 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0563 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0563 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0563 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0563 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0563 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0563 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0563 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0563 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0563 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0563 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0563 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0563 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0563 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0563 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0563 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0563 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0563 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0563 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0563 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0563 - lr: 1.6788e-10
Average Validation Loss: 0.07069863826036453
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:33:29.395004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:29.395395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:29.395861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:29.448138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:29.448474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:29.448816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:29.529987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:29.530469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:29.530874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:29.589634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:29.590088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:29.590506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:29.821573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:29.822227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:29.822700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:29.882110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:29.882618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:29.883044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.1309 - val_loss: 0.1253 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0734
2023-11-26 16:33:30.490829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:30.491308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:30.491990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:30.553442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:30.553886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:30.554304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1066 - val_loss: 0.1206 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0991 - val_loss: 0.1170 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0944 - val_loss: 0.1168 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0945 - val_loss: 0.1134 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0873 - val_loss: 0.1123 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0869 - val_loss: 0.1106 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0889 - val_loss: 0.1091 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0829 - val_loss: 0.1057 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0812 - val_loss: 0.1045 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.1026 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0658 - val_loss: 0.0999 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0978 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.1051 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0915 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0961 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0880 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.1002 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0855 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0966 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0872 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0928 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0422 - val_loss: 0.0912 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0916 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0413 - val_loss: 0.0874 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0910 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0879 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0905 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0885 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0382 - val_loss: 0.0879 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0877 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0359 - val_loss: 0.0886 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0874 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0387 - val_loss: 0.0877 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0383 - val_loss: 0.0870 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.0875 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0876 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0389 - val_loss: 0.0877 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0877 - lr: 3.3460e-06
Epoch 1/100
2023-11-26 16:33:33.245904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:33.246271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:33.246623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:33.298707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:33.299067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:33.299403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:33.376142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:33.376609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:33.377034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:33.435184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:33.435636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:33.436044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:33.618844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:33.619319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:33.620028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:33.679186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:33.679661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:33.679997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1256 - val_loss: 0.0685 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0831
2023-11-26 16:33:34.160204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:34.160644: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:34.161170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:34.222220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:34.222687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:34.223121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1185 - val_loss: 0.0733 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1118 - val_loss: 0.0680 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1105 - val_loss: 0.0636 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1066 - val_loss: 0.0705 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1028 - val_loss: 0.0804 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1034 - val_loss: 0.0552 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0993 - val_loss: 0.0905 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0932 - val_loss: 0.0692 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0939 - val_loss: 0.0694 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0900 - val_loss: 0.0702 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0832 - val_loss: 0.0832 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0785 - val_loss: 0.0777 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0758 - val_loss: 0.0755 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0748 - val_loss: 0.0714 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0704 - val_loss: 0.0689 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0682 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0688 - val_loss: 0.0671 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0658 - val_loss: 0.0660 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0629 - val_loss: 0.0691 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0588 - val_loss: 0.0741 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0560 - val_loss: 0.0710 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0550 - val_loss: 0.0707 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0543 - val_loss: 0.0701 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0524 - val_loss: 0.0728 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0528 - val_loss: 0.0703 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0707 - lr: 9.0718e-05
Epoch 1/100
2023-11-26 16:33:36.591891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:36.592363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:36.592927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:36.646661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:36.647052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:36.647396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:36.726832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:36.727321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:36.727747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:36.786468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:36.786938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:36.787369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:37.019672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:37.020142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:37.020640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:37.078148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:37.078619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:37.079046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.1120 - val_loss: 0.1046 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0657
2023-11-26 16:33:37.781223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:37.781746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:37.782288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:37.848826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:37.849431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:37.849916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1030 - val_loss: 0.0994 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0985 - val_loss: 0.0913 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0957 - val_loss: 0.0866 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0932 - val_loss: 0.0830 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0907 - val_loss: 0.0785 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0919 - val_loss: 0.0791 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0879 - val_loss: 0.0744 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0854 - val_loss: 0.0706 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0847 - val_loss: 0.0701 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0687 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0672 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0597 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0619 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0644 - val_loss: 0.0578 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0539 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0546 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0516 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0481 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0480 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0482 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0464 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0438 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0433 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0445 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0450 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0455 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0451 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0453 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0449 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0450 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0453 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0455 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0453 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0451 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0450 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0451 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0451 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0451 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0451 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0451 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0451 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0451 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0451 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:33:44.527765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:44.528200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:44.528775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:44.583241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:44.583567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:44.583945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:44.664976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:44.665456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:44.665889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:44.727180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:44.727588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:44.728003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:44.967788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:44.968535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:44.968964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:45.029573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:45.030094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:45.030520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1143 - val_loss: 0.1060 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1028
2023-11-26 16:33:45.780644: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:45.781237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:45.781637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:33:45.842215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:33:45.842660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:33:45.843049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1079 - val_loss: 0.1005 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1028 - val_loss: 0.0980 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0985 - val_loss: 0.0961 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0944 - val_loss: 0.0929 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0932 - val_loss: 0.0940 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0859 - val_loss: 0.0871 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0809 - val_loss: 0.0789 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0803 - val_loss: 0.0815 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0757 - val_loss: 0.0759 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0839 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0661 - val_loss: 0.0827 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0797 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0715 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0709 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0696 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0671 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0694 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0671 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0726 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0706 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0700 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0688 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0695 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0649 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0639 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0594 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0585 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0567 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0558 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0550 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0548 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0545 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0542 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0450 - val_loss: 0.0540 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0539 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0538 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0538 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0537 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0537 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0537 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0537 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0537 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0537 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0537 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0537 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0537 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0537 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0537 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0537 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0537 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0537 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0537 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0537 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0537 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0537 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0537 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0537 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0537 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0537 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0537 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0537 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0537 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0537 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0537 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0537 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0537 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0537 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0537 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0537 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0537 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0537 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0537 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0537 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0537 - lr: 2.2897e-14
Epoch 1/100
2023-11-26 16:34:00.855643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:00.856103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:00.856686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:00.908345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:00.908727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:00.909112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:00.991978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:00.992462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:00.992888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:01.052255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:01.052710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:01.053126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:01.284065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:01.284569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:01.285071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:01.342537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:01.343022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:01.343472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1172 - val_loss: 0.0963 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0640
2023-11-26 16:34:02.148445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:02.149044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:02.149664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:02.209513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:02.209868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:02.210265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.0927 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1010 - val_loss: 0.0897 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0976 - val_loss: 0.0852 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0931 - val_loss: 0.0826 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0872 - val_loss: 0.0819 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0834 - val_loss: 0.0782 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0758 - val_loss: 0.0770 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0740 - val_loss: 0.0724 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0663 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0647 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0602 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0587 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0571 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0558 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0565 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0547 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0527 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0529 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0515 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0510 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0412 - val_loss: 0.0503 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0506 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0401 - val_loss: 0.0507 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0396 - val_loss: 0.0500 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0394 - val_loss: 0.0498 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0388 - val_loss: 0.0503 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0385 - val_loss: 0.0500 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0391 - val_loss: 0.0496 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0391 - val_loss: 0.0491 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0384 - val_loss: 0.0491 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0386 - val_loss: 0.0488 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0486 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0485 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0484 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0384 - val_loss: 0.0484 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0484 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0484 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0484 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0484 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0484 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0484 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0484 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0484 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0484 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0484 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0484 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0484 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0484 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0484 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0484 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0484 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0484 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0484 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0484 - lr: 3.7267e-09
Average Validation Loss: 0.05721404924988747
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 16:34:15.345072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:15.345651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:15.346028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:15.397829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:15.398215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:15.398561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:15.478229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:15.478701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:15.479114: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:15.538238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:15.538712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:15.539134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:15.769850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:15.770302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:15.770832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:15.828931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:15.829388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:15.829806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1527 - val_loss: 0.1303 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0657
2023-11-26 16:34:16.423416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:16.423972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:16.424425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:16.485062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:16.485470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:16.485860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 5ms/step - loss: 0.1028 - val_loss: 0.1267 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1009 - val_loss: 0.1264 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1003 - val_loss: 0.1214 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0953 - val_loss: 0.1156 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0944 - val_loss: 0.1121 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.1109 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0885 - val_loss: 0.1098 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.1064 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.1009 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.0961 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0931 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0913 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0915 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0905 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0939 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0964 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0893 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0963 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0882 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0440 - val_loss: 0.0922 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0919 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0896 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0901 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0905 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0901 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0903 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0439 - val_loss: 0.0910 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0909 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.0905 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0898 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0896 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0897 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0896 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0895 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0896 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0898 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0899 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0899 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0434 - val_loss: 0.0900 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:34:18.365256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:18.365691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:18.366256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:18.416636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:18.417017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:18.417382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:18.496025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:18.496497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:18.496910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:18.555316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:18.555798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:18.556216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:18.735630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:18.736087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:18.736642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:18.793130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:18.793577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:18.793985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 18ms/step - loss: 0.1403 - val_loss: 0.0711 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0510
2023-11-26 16:34:19.250255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:19.250730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:19.251383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:19.311681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:19.312100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:19.312480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 3ms/step - loss: 0.1097 - val_loss: 0.0702 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1038 - val_loss: 0.0768 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0965 - val_loss: 0.0698 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0893 - val_loss: 0.0720 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0869 - val_loss: 0.0634 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0837 - val_loss: 0.0632 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0677 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0724 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0729 - val_loss: 0.0631 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0710 - val_loss: 0.0573 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0587 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0593 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0683 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0673 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0633 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0566 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0620 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0661 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0594 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0651 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0630 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0638 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0611 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0604 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0637 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0607 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0611 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0604 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0599 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0599 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0607 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0613 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0616 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0617 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0619 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0620 - lr: 6.0967e-06
Epoch 1/100
2023-11-26 16:34:21.411001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:21.411594: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:21.411988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:21.462947: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:21.463336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:21.463665: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:21.543645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:21.544105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:21.544524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:21.603633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:21.604119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:21.604531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:21.835709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:21.836339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:21.836782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:21.894418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:21.894875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:21.895304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 14ms/step - loss: 0.1252 - val_loss: 0.1143 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0595
2023-11-26 16:34:22.541573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:22.542040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:22.542501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:22.603421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:22.603855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:22.604236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.1054 - val_loss: 0.1129 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0963 - val_loss: 0.0992 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0920 - val_loss: 0.0898 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0884 - val_loss: 0.0811 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0872 - val_loss: 0.0759 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0814 - val_loss: 0.0699 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0796 - val_loss: 0.0662 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.0654 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0632 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0581 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0661 - val_loss: 0.0572 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0643 - val_loss: 0.0570 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0652 - val_loss: 0.0571 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0564 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0515 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0496 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0473 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0466 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0465 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0471 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0530 - val_loss: 0.0461 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0526 - val_loss: 0.0464 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0477 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0454 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0497 - val_loss: 0.0459 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0459 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0455 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0462 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0455 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0448 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0456 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0458 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0456 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0455 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0455 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0454 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0455 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0455 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0456 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0456 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0456 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0456 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0456 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0456 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0456 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0456 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0456 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0456 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0456 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0456 - lr: 2.7536e-08
Epoch 1/100
2023-11-26 16:34:27.528214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:27.528611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:27.529087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:27.581511: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:27.581894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:27.582376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:27.664759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:27.665247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:27.665715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:27.725825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:27.726291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:27.726707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:27.966461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:27.966928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:27.967664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:28.025736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:28.026184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:28.026551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.1153 - val_loss: 0.1017 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0688
2023-11-26 16:34:28.686707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:28.687348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:28.687880: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:28.749335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:28.749787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:28.750173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.0993 - val_loss: 0.1117 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0972 - val_loss: 0.1263 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0947 - val_loss: 0.1266 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0935 - val_loss: 0.1331 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0946 - val_loss: 0.1219 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.1184 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0906 - val_loss: 0.1223 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0889 - val_loss: 0.1227 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0888 - val_loss: 0.1156 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0873 - val_loss: 0.1136 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.0968 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.1100 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0815 - val_loss: 0.0973 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.1001 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0958 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0926 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0908 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0836 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0665 - val_loss: 0.0838 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0649 - val_loss: 0.0797 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0742 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0754 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0675 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0685 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0672 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0625 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0644 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0640 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0611 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0613 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0615 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0610 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0609 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0609 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0608 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0606 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0604 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0604 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0604 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0604 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0539 - val_loss: 0.0604 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0604 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0604 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0604 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0604 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0604 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0604 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0604 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0604 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0604 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0604 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0604 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0604 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0604 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0604 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0604 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0604 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0604 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0604 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0604 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0604 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0604 - lr: 5.0565e-11
Epoch 1/100
2023-11-26 16:34:36.235411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:36.235809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:36.236396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:36.290666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:36.291061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:36.291415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:36.371937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:36.372415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:36.372830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:36.433626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:36.434096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:36.434500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:36.669856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:36.670331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:36.670794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:36.729161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:36.729567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:36.729992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 2s 10ms/step - loss: 0.1154 - val_loss: 0.0936 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0617
2023-11-26 16:34:37.796963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:37.797450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:37.798100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:37.859041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:37.859497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:37.860111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.0940 - val_loss: 0.0795 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0831 - val_loss: 0.0676 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0636 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0578 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0605 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0529 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0515 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0505 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0486 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0545 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0538 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0498 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0563 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0539 - val_loss: 0.0607 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0551 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0534 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0470 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0479 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0467 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0460 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0453 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0404 - val_loss: 0.0447 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0400 - val_loss: 0.0441 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0395 - val_loss: 0.0442 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0397 - val_loss: 0.0443 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0392 - val_loss: 0.0438 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0393 - val_loss: 0.0434 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0390 - val_loss: 0.0432 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0385 - val_loss: 0.0430 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0428 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0388 - val_loss: 0.0428 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0391 - val_loss: 0.0428 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0389 - val_loss: 0.0428 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0381 - val_loss: 0.0429 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0381 - val_loss: 0.0428 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0385 - val_loss: 0.0428 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0428 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0383 - val_loss: 0.0429 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0429 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0386 - val_loss: 0.0429 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0429 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0385 - val_loss: 0.0429 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0429 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0429 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0382 - val_loss: 0.0429 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0429 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0429 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0429 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0429 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0376 - val_loss: 0.0429 - lr: 2.7536e-08
Average Validation Loss: 0.058543364703655246
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 16:34:45.246495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:45.246846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:45.247738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:45.301143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:45.301499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:45.301838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:45.386026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:45.386521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:45.386942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:45.446439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:45.446930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:45.447355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:45.682147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:45.682608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:45.683054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:45.741130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:45.741582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:45.742000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 66ms/step - loss: 0.1596 - val_loss: 0.1260 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0784
2023-11-26 16:34:46.303610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:46.304103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:46.304770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:46.367119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:46.367576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:46.368039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 9ms/step - loss: 0.1040 - val_loss: 0.1209 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0977 - val_loss: 0.1262 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1023 - val_loss: 0.1296 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1011 - val_loss: 0.1302 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1028 - val_loss: 0.1290 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1019 - val_loss: 0.1268 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0994 - val_loss: 0.1251 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1023 - val_loss: 0.1234 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0997 - val_loss: 0.1222 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0948 - val_loss: 0.1212 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0916 - val_loss: 0.1201 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0922 - val_loss: 0.1191 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0909 - val_loss: 0.1178 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0884 - val_loss: 0.1166 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0854 - val_loss: 0.1155 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0849 - val_loss: 0.1149 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0843 - val_loss: 0.1149 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0829 - val_loss: 0.1150 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0831 - val_loss: 0.1146 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0803 - val_loss: 0.1139 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0792 - val_loss: 0.1132 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0786 - val_loss: 0.1124 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0757 - val_loss: 0.1117 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0768 - val_loss: 0.1114 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0773 - val_loss: 0.1111 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0754 - val_loss: 0.1108 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0758 - val_loss: 0.1107 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.1106 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0737 - val_loss: 0.1106 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0751 - val_loss: 0.1106 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0749 - val_loss: 0.1105 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.1105 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0746 - val_loss: 0.1105 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.1104 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0752 - val_loss: 0.1104 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0757 - val_loss: 0.1104 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0776 - val_loss: 0.1104 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0721 - val_loss: 0.1104 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0729 - val_loss: 0.1104 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0727 - val_loss: 0.1104 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0734 - val_loss: 0.1104 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0733 - val_loss: 0.1104 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0737 - val_loss: 0.1104 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0751 - val_loss: 0.1104 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0728 - val_loss: 0.1104 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0745 - val_loss: 0.1104 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0750 - val_loss: 0.1104 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0725 - val_loss: 0.1104 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0756 - val_loss: 0.1104 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0731 - val_loss: 0.1104 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0744 - val_loss: 0.1104 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0738 - val_loss: 0.1104 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.1104 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0733 - val_loss: 0.1104 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0733 - val_loss: 0.1104 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0755 - val_loss: 0.1104 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.1104 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0732 - val_loss: 0.1104 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0759 - val_loss: 0.1104 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0743 - val_loss: 0.1104 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0731 - val_loss: 0.1104 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0744 - val_loss: 0.1104 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0771 - val_loss: 0.1104 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0753 - val_loss: 0.1104 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0745 - val_loss: 0.1104 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0737 - val_loss: 0.1104 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0719 - val_loss: 0.1104 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0751 - val_loss: 0.1104 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0725 - val_loss: 0.1104 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0716 - val_loss: 0.1104 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0751 - val_loss: 0.1104 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.1104 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0752 - val_loss: 0.1104 - lr: 4.6110e-14
Epoch 75/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0713 - val_loss: 0.1104 - lr: 2.2897e-14
Epoch 76/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0738 - val_loss: 0.1104 - lr: 1.1370e-14
Epoch 77/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0743 - val_loss: 0.1104 - lr: 5.6464e-15
Epoch 78/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0724 - val_loss: 0.1104 - lr: 2.8039e-15
Epoch 1/100
2023-11-26 16:34:49.247318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:49.247698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:49.248306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:49.300474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:49.300825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:49.301176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:49.384185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:49.384670: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:49.385100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:49.444332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:49.444819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:49.445269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:49.687115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:49.687768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:49.688322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:49.747835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:49.748287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:49.748718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1495 - val_loss: 0.0942 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0783
2023-11-26 16:34:50.345932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:50.346457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:50.347145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:50.409464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:50.409924: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:50.410310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1140 - val_loss: 0.0725 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1128 - val_loss: 0.0671 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1070 - val_loss: 0.0743 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1024 - val_loss: 0.0751 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.0728 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0865 - val_loss: 0.0744 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0816 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0794 - val_loss: 0.0706 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0713 - val_loss: 0.0716 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0675 - val_loss: 0.0761 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0673 - val_loss: 0.0604 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0645 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0627 - val_loss: 0.0800 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0640 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0693 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0665 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0631 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0681 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0570 - val_loss: 0.0620 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0587 - val_loss: 0.0708 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0560 - val_loss: 0.0628 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0552 - val_loss: 0.0667 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0557 - val_loss: 0.0640 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0636 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0560 - val_loss: 0.0640 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0565 - val_loss: 0.0640 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0558 - val_loss: 0.0637 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0556 - val_loss: 0.0629 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0537 - val_loss: 0.0628 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0549 - val_loss: 0.0629 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0559 - val_loss: 0.0632 - lr: 2.7324e-05
Epoch 1/100
2023-11-26 16:34:52.103615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:52.104060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:52.104642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:52.157431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:52.157818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:52.158157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:52.240097: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:52.240584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:52.241087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:52.302928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:52.303438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:52.303896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:52.546199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:52.546675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:52.547233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:52.604706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:52.605156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:52.605556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 27ms/step - loss: 0.1474 - val_loss: 0.1238 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.0983
2023-11-26 16:34:53.218280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:53.218850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:53.219490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:53.287408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:53.287956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:53.288444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1039 - val_loss: 0.1082 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0994 - val_loss: 0.1127 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.1028 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0995 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0968 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0875 - val_loss: 0.0909 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.0886 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0847 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0819 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0800 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0772 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0808 - val_loss: 0.0751 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0732 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.0736 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0715 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0749 - val_loss: 0.0705 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0756 - val_loss: 0.0704 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0752 - val_loss: 0.0695 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0696 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0729 - val_loss: 0.0689 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0733 - val_loss: 0.0687 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0679 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0680 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0677 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0723 - val_loss: 0.0675 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0677 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0677 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0676 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0677 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0677 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0676 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0675 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0675 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0676 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0676 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0676 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0715 - val_loss: 0.0676 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0700 - val_loss: 0.0675 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0725 - val_loss: 0.0675 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0675 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0675 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0675 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0705 - val_loss: 0.0675 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0712 - val_loss: 0.0675 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0719 - val_loss: 0.0675 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0714 - val_loss: 0.0675 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0716 - val_loss: 0.0675 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0707 - val_loss: 0.0675 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0675 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0675 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0675 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0675 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:34:57.047039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:57.047417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:57.047763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:57.100718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:57.101101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:57.101479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:57.180327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:57.180800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:57.181201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:57.241361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:57.241823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:57.242237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:57.474150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:57.474684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:57.475124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:57.532517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:57.532979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:57.533397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 21ms/step - loss: 0.1104 - val_loss: 0.1030 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1193
2023-11-26 16:34:58.162007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:58.162494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:58.163142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:34:58.234042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:34:58.235107: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:34:58.235578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1022 - val_loss: 0.0945 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0986 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0927 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.1004 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0878 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.0816 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.0904 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0881 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0796 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.0791 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0791 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0768 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0639 - val_loss: 0.0735 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0731 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0740 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0710 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0667 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0655 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0652 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0630 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0596 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0586 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0567 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0557 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0558 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0544 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0545 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0543 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0533 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0534 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0530 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0529 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0526 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0526 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0526 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0526 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0526 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0526 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0526 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0526 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0525 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0525 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0525 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0525 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0525 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0525 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0525 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0525 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0525 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0525 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0525 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0525 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0525 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0525 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0525 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0525 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0525 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0525 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0525 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0525 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0525 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0525 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0525 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0525 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0525 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0525 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0525 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0525 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0525 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0525 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0525 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0525 - lr: 2.2897e-14
Epoch 1/100
2023-11-26 16:35:04.482392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:04.482830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:04.483360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:04.535395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:04.535804: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:04.536135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:04.619070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:04.619550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:04.619983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:04.680142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:04.680618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:04.681035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:04.921117: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:04.921642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:04.922042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:04.989073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:04.989549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:04.989996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 16ms/step - loss: 0.1371 - val_loss: 0.1018 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1125
2023-11-26 16:35:05.618740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:05.619211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:05.619891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:05.680186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:05.680601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:05.680979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 5ms/step - loss: 0.1109 - val_loss: 0.1011 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0995 - val_loss: 0.1004 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.0996 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0986 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0974 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0866 - val_loss: 0.0964 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0849 - val_loss: 0.0967 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0943 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0939 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0936 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0907 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0901 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0900 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0682 - val_loss: 0.0883 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0667 - val_loss: 0.0876 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0636 - val_loss: 0.0853 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0863 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0841 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0830 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0820 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0808 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0549 - val_loss: 0.0801 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0792 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0790 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0782 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0780 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0776 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0775 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0772 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0504 - val_loss: 0.0770 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0769 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0768 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0767 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0768 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0767 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0767 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0767 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0767 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0767 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0504 - val_loss: 0.0767 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0767 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0767 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0767 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0767 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0767 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0767 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0767 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0767 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0767 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0767 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0767 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0767 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0767 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0767 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0767 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0767 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0767 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0767 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0767 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0767 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0767 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0767 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0767 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0767 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0767 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0767 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0767 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0767 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0767 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0767 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0767 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0767 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0767 - lr: 4.6110e-14
Average Validation Loss: 0.07349421083927155
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:35:13.118841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:13.119222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:13.119738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:13.170412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:13.170773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:13.171118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:13.250569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:13.251043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:13.251481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:13.310294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:13.310748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:13.311160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:13.950973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:13.951540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:13.952300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:14.021229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:14.021692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:14.022145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 2s 19ms/step - loss: 0.2037 - val_loss: 0.1905 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1323
2023-11-26 16:35:14.652125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:14.652844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:14.653928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:14.716105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:14.716612: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:14.717021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1714 - val_loss: 0.1797 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1625 - val_loss: 0.1683 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1478 - val_loss: 0.1655 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1438 - val_loss: 0.1604 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1421 - val_loss: 0.1571 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1330 - val_loss: 0.1569 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1269 - val_loss: 0.1557 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1201 - val_loss: 0.1560 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1207 - val_loss: 0.1434 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1023 - val_loss: 0.1468 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0921 - val_loss: 0.1606 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1076 - val_loss: 0.1334 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0904 - val_loss: 0.1336 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0823 - val_loss: 0.1349 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0835 - val_loss: 0.1401 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0878 - val_loss: 0.1280 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0796 - val_loss: 0.1241 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0767 - val_loss: 0.1394 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0828 - val_loss: 0.1252 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0774 - val_loss: 0.1259 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.1245 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.1257 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.1258 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0751 - val_loss: 0.1226 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0748 - val_loss: 0.1240 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0746 - val_loss: 0.1229 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0728 - val_loss: 0.1225 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.1230 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0733 - val_loss: 0.1240 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0720 - val_loss: 0.1228 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0735 - val_loss: 0.1208 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.1205 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1212 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.1216 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.1213 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.1215 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1217 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.1217 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.1218 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0734 - val_loss: 0.1217 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0730 - val_loss: 0.1217 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1217 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.1217 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0735 - val_loss: 0.1218 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.1218 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.1218 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.1218 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.1218 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0730 - val_loss: 0.1218 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1218 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.1218 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.1218 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:35:18.397363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:18.398004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:18.398429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:18.451108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:18.451618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:18.452068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:18.540815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:18.541554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:18.542092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:18.605427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:18.605985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:18.606628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:18.785721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:18.786173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:18.786583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:18.843766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:18.844233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:18.844678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1959 - val_loss: 0.1323 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1565
2023-11-26 16:35:19.328993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:19.329462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:19.330001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:19.390668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:19.391105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:19.391521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1761 - val_loss: 0.1286 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1640 - val_loss: 0.1165 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1565 - val_loss: 0.1086 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1496 - val_loss: 0.1027 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1450 - val_loss: 0.1001 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1394 - val_loss: 0.1037 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1347 - val_loss: 0.0984 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1346 - val_loss: 0.0879 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1255 - val_loss: 0.0965 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1211 - val_loss: 0.0863 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1142 - val_loss: 0.1015 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1090 - val_loss: 0.1001 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1065 - val_loss: 0.0937 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1012 - val_loss: 0.0969 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0955 - val_loss: 0.0942 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0917 - val_loss: 0.0908 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0923 - val_loss: 0.0859 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0865 - val_loss: 0.0854 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0835 - val_loss: 0.0830 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0788 - val_loss: 0.0820 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0782 - val_loss: 0.0832 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0753 - val_loss: 0.0814 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0736 - val_loss: 0.0810 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0720 - val_loss: 0.0790 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0707 - val_loss: 0.0803 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0783 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0780 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0786 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0696 - val_loss: 0.0784 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0694 - val_loss: 0.0780 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0695 - val_loss: 0.0780 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0686 - val_loss: 0.0778 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0698 - val_loss: 0.0781 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0696 - val_loss: 0.0781 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0780 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0780 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0780 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0682 - val_loss: 0.0781 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0689 - val_loss: 0.0780 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0780 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0689 - val_loss: 0.0780 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0697 - val_loss: 0.0779 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0780 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0685 - val_loss: 0.0780 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0693 - val_loss: 0.0780 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0695 - val_loss: 0.0780 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0686 - val_loss: 0.0780 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0699 - val_loss: 0.0780 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0680 - val_loss: 0.0780 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0684 - val_loss: 0.0780 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0691 - val_loss: 0.0780 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0689 - val_loss: 0.0780 - lr: 6.1442e-09
Epoch 1/100
2023-11-26 16:35:24.163366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:24.163871: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:24.164378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:24.214785: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:24.215159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:24.215487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:24.294660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:24.295133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:24.295541: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:24.354604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:24.355082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:24.355493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:24.590654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:24.591326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:24.591808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:24.650725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:24.651190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:24.651611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.1759 - val_loss: 0.1586 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1142
2023-11-26 16:35:25.363411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:25.363913: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:25.364569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:25.426880: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:25.427341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:25.427732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1540 - val_loss: 0.1393 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1388 - val_loss: 0.1280 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1314 - val_loss: 0.1177 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1261 - val_loss: 0.1154 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1222 - val_loss: 0.1125 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1195 - val_loss: 0.1110 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1136 - val_loss: 0.1061 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1087 - val_loss: 0.1040 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1048 - val_loss: 0.0949 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0998 - val_loss: 0.0959 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0956 - val_loss: 0.0925 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0905 - val_loss: 0.0862 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0861 - val_loss: 0.0846 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0819 - val_loss: 0.0783 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0779 - val_loss: 0.0752 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0744 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0732 - val_loss: 0.0749 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0724 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0716 - val_loss: 0.0693 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0719 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0716 - val_loss: 0.0712 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0682 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0646 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0691 - val_loss: 0.0630 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0618 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0666 - val_loss: 0.0613 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0643 - val_loss: 0.0601 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0599 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0595 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0593 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0592 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0592 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0592 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0592 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0592 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0592 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0592 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0591 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0591 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0591 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0591 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0604 - val_loss: 0.0591 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0591 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0591 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0591 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0591 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0591 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0591 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0591 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0591 - lr: 1.6702e-08
Epoch 53/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0591 - lr: 1.0130e-08
Epoch 54/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0591 - lr: 6.1442e-09
Epoch 55/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0591 - lr: 3.7267e-09
Epoch 56/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0591 - lr: 2.2603e-09
Epoch 57/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0591 - lr: 1.3710e-09
Epoch 58/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0591 - lr: 8.3153e-10
Epoch 59/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0591 - lr: 5.0435e-10
Epoch 60/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0591 - lr: 3.0590e-10
Epoch 61/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0591 - lr: 1.6788e-10
Epoch 62/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0591 - lr: 9.2136e-11
Epoch 63/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0591 - lr: 5.0565e-11
Epoch 64/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0591 - lr: 2.7751e-11
Epoch 65/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0591 - lr: 1.5230e-11
Epoch 66/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0591 - lr: 8.3584e-12
Epoch 67/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0591 - lr: 4.5872e-12
Epoch 68/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0591 - lr: 2.5175e-12
Epoch 69/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0591 - lr: 1.3816e-12
Epoch 70/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0591 - lr: 7.5826e-13
Epoch 71/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0591 - lr: 3.7654e-13
Epoch 72/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0591 - lr: 1.8698e-13
Epoch 73/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0591 - lr: 9.2853e-14
Epoch 1/100
2023-11-26 16:35:36.620566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:36.621111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:36.621548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:36.674843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:36.675244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:36.675588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:36.754946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:36.755420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:36.755833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:36.814776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:36.815219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:36.815626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:37.047377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:37.047845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:37.048280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:37.105522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:37.105977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:37.106470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1785 - val_loss: 0.1735 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1840
2023-11-26 16:35:37.863824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:37.864250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:37.864657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:37.926139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:37.926584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:37.926967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1570 - val_loss: 0.1538 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1425 - val_loss: 0.1456 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1340 - val_loss: 0.1453 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1292 - val_loss: 0.1297 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1192 - val_loss: 0.1345 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1182 - val_loss: 0.1244 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1095 - val_loss: 0.1248 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1055 - val_loss: 0.1112 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0990 - val_loss: 0.1138 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0942 - val_loss: 0.1025 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0872 - val_loss: 0.1114 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0843 - val_loss: 0.1027 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0826 - val_loss: 0.0929 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0873 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.0901 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0751 - val_loss: 0.0843 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0838 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0713 - val_loss: 0.0832 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0794 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0841 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0826 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0813 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0802 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0784 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0736 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0683 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0637 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0636 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0620 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0614 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0605 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0601 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0598 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0599 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0597 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0598 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0597 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0597 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0597 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0597 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0597 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0597 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0597 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0596 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0596 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0644 - val_loss: 0.0596 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0596 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0596 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0643 - val_loss: 0.0596 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0596 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0596 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0596 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0596 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0596 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0596 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0596 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0596 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0596 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0596 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0596 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0596 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0596 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0596 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0596 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0596 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0596 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0596 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0596 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0646 - val_loss: 0.0596 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0596 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0596 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0596 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0596 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0596 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0596 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0596 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0596 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0596 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0596 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0596 - lr: 3.1068e-16
Epoch 1/100
2023-11-26 16:35:54.057254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:54.057670: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:54.058239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:54.110799: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:54.111221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:54.111589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:54.193398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:54.193915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:54.194331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:54.256054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:54.256581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:54.257043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:54.527884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:54.528321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:54.529591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:54.594829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:54.595295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:54.595801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1684 - val_loss: 0.1432 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1120
2023-11-26 16:35:55.432749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:55.433222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:55.433879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:35:55.494931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:35:55.495383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:35:55.495786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1440 - val_loss: 0.1281 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1304 - val_loss: 0.1198 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1206 - val_loss: 0.1142 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1130 - val_loss: 0.1090 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1095 - val_loss: 0.1050 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1027 - val_loss: 0.0959 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0940 - val_loss: 0.0951 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0924 - val_loss: 0.0890 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0839 - val_loss: 0.0831 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0782 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0758 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0743 - val_loss: 0.0784 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0731 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0771 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0723 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0689 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0685 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0686 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0694 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0666 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0640 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0636 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0637 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0640 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0631 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0628 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0629 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0622 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0620 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0619 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0618 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0617 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0617 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0617 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0617 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0617 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0617 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0617 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0617 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0618 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0618 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0618 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0618 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0618 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0618 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0618 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0618 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0618 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0618 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0618 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0618 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0618 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0618 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0618 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0618 - lr: 1.3710e-09
Average Validation Loss: 0.07573950737714767
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
2023-11-26 16:36:09.586590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:09.587356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:09.587822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:09.642348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:09.642734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:09.643072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:09.727859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:09.728318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:09.728658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:09.787626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:09.788102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:09.788647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:10.034156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:10.034667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:10.035159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:10.096891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:10.097477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:10.097862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.2030 - val_loss: 0.1796 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1149
2023-11-26 16:36:10.695354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:10.696140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:10.696600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:10.758047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:10.758502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:10.758885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 5ms/step - loss: 0.1594 - val_loss: 0.1868 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1630 - val_loss: 0.1847 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1619 - val_loss: 0.1749 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1551 - val_loss: 0.1665 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1482 - val_loss: 0.1643 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1429 - val_loss: 0.1623 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1397 - val_loss: 0.1617 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1363 - val_loss: 0.1595 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1341 - val_loss: 0.1573 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1300 - val_loss: 0.1546 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1209 - val_loss: 0.1528 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1169 - val_loss: 0.1471 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1101 - val_loss: 0.1481 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1074 - val_loss: 0.1447 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1054 - val_loss: 0.1440 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1031 - val_loss: 0.1418 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.1465 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0969 - val_loss: 0.1386 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0963 - val_loss: 0.1458 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.1416 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0954 - val_loss: 0.1388 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.1460 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.1430 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0926 - val_loss: 0.1383 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.1381 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0915 - val_loss: 0.1394 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.1407 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.1418 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0883 - val_loss: 0.1416 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.1408 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0923 - val_loss: 0.1400 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.1400 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.1403 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0925 - val_loss: 0.1402 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0894 - val_loss: 0.1403 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0917 - val_loss: 0.1405 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.1405 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.1404 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.1404 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.1405 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0872 - val_loss: 0.1405 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.1404 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.1404 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.1404 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.1404 - lr: 2.2487e-07
Epoch 1/100
2023-11-26 16:36:13.422082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:13.422582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:13.423160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:13.474163: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:13.474532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:13.474831: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:13.553462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:13.553945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:13.554537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:13.613030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:13.613495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:13.613900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:13.801215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:13.801691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:13.802312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:13.861292: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:13.861762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:13.862417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.2346 - val_loss: 0.1745 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1312
2023-11-26 16:36:14.321958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:14.322458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:14.323136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:14.386752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:14.387260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:14.387639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 4ms/step - loss: 0.1861 - val_loss: 0.1442 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1747 - val_loss: 0.1336 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1628 - val_loss: 0.1235 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1544 - val_loss: 0.1115 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1472 - val_loss: 0.1092 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1415 - val_loss: 0.1010 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1376 - val_loss: 0.0924 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1281 - val_loss: 0.1023 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1211 - val_loss: 0.0924 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1179 - val_loss: 0.0974 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1081 - val_loss: 0.0961 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1037 - val_loss: 0.0960 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1040 - val_loss: 0.0897 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1021 - val_loss: 0.0888 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0979 - val_loss: 0.0924 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0954 - val_loss: 0.0916 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0969 - val_loss: 0.0930 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0939 - val_loss: 0.0960 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0919 - val_loss: 0.0883 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0929 - val_loss: 0.0926 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0908 - val_loss: 0.0915 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0906 - val_loss: 0.0898 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0898 - val_loss: 0.0910 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0901 - val_loss: 0.0915 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0884 - val_loss: 0.0925 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0897 - val_loss: 0.0943 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0882 - val_loss: 0.0898 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0898 - val_loss: 0.0934 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0896 - val_loss: 0.0931 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.0929 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0891 - val_loss: 0.0925 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0881 - val_loss: 0.0929 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0884 - val_loss: 0.0925 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0889 - val_loss: 0.0922 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0882 - val_loss: 0.0922 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0876 - val_loss: 0.0919 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0884 - val_loss: 0.0919 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0887 - val_loss: 0.0920 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0880 - val_loss: 0.0920 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:36:16.749101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:16.749475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:16.749868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:16.802127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:16.802513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:16.802940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:16.890268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:16.890775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:16.891216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:16.957316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:16.957984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:16.958449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:17.205307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:17.205859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:17.206307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:17.264819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:17.265283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:17.265700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 14ms/step - loss: 0.1908 - val_loss: 0.1704 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1352
2023-11-26 16:36:17.919569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:17.920092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:17.920760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:17.986278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:17.986729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:17.987118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.1672 - val_loss: 0.1591 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1510 - val_loss: 0.1424 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1397 - val_loss: 0.1261 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1306 - val_loss: 0.1163 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1225 - val_loss: 0.1076 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1162 - val_loss: 0.1036 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1091 - val_loss: 0.0979 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1051 - val_loss: 0.0910 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1017 - val_loss: 0.0935 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0986 - val_loss: 0.0854 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0925 - val_loss: 0.0825 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0921 - val_loss: 0.0807 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0878 - val_loss: 0.0805 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0877 - val_loss: 0.0779 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0871 - val_loss: 0.0785 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0868 - val_loss: 0.0748 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0873 - val_loss: 0.0742 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0860 - val_loss: 0.0780 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0840 - val_loss: 0.0832 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0834 - val_loss: 0.0866 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0805 - val_loss: 0.0822 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0781 - val_loss: 0.0782 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0774 - val_loss: 0.0785 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0775 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.0763 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0758 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.0755 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0764 - val_loss: 0.0757 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0768 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0749 - val_loss: 0.0758 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0762 - val_loss: 0.0759 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0756 - val_loss: 0.0764 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0757 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0760 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.0760 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.0760 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.0757 - lr: 4.5166e-06
Epoch 1/100
2023-11-26 16:36:21.741355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:21.741855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:21.742344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:21.793387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:21.793827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:21.794197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:21.876666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:21.877148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:21.877590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:21.937165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:21.937625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:21.938141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:22.178177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:22.178642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:22.179432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:22.238050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:22.238527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:22.238954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.1884 - val_loss: 0.1609 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1432
2023-11-26 16:36:22.903023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:22.903689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:22.904182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:22.967160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:22.967597: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:22.968057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.1572 - val_loss: 0.1457 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1396 - val_loss: 0.1338 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1249 - val_loss: 0.1213 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1166 - val_loss: 0.1067 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1053 - val_loss: 0.1054 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1037 - val_loss: 0.0966 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0978 - val_loss: 0.0989 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0949 - val_loss: 0.0924 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0929 - val_loss: 0.0883 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0877 - val_loss: 0.0918 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0853 - val_loss: 0.0873 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0827 - val_loss: 0.0864 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0882 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0869 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0917 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0904 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0939 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0977 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0772 - val_loss: 0.1051 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0863 - val_loss: 0.1015 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0893 - val_loss: 0.0721 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0684 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0787 - val_loss: 0.0652 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0750 - val_loss: 0.0647 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0763 - val_loss: 0.0647 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0738 - val_loss: 0.0644 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0728 - val_loss: 0.0644 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.0643 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0716 - val_loss: 0.0642 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0720 - val_loss: 0.0642 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0642 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0642 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0642 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0642 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0641 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0641 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0641 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0710 - val_loss: 0.0641 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0707 - val_loss: 0.0641 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.0641 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0641 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.0641 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.0641 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0641 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0713 - val_loss: 0.0641 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0641 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0641 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0641 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0710 - val_loss: 0.0641 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0641 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0641 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0709 - val_loss: 0.0641 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0641 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0641 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0641 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0641 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0710 - val_loss: 0.0641 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0641 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.0641 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0641 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.0641 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0698 - val_loss: 0.0641 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0707 - val_loss: 0.0641 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0641 - lr: 8.3584e-12
Epoch 1/100
2023-11-26 16:36:30.990408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:30.991011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:30.991332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:31.050999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:31.051828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:31.052276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:31.141195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:31.141691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:31.142140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:31.205130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:31.205836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:31.206461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:31.455858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:31.456313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:31.456903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:31.515121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:31.515583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:31.516084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 10ms/step - loss: 0.1981 - val_loss: 0.1589 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1210
2023-11-26 16:36:32.217789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:32.218212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:32.218704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:32.280447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:32.280953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:32.281458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.1597 - val_loss: 0.1463 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1399 - val_loss: 0.1349 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1268 - val_loss: 0.1264 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1155 - val_loss: 0.1184 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1098 - val_loss: 0.1121 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1038 - val_loss: 0.1050 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1006 - val_loss: 0.0988 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0932 - val_loss: 0.0908 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0873 - val_loss: 0.0829 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0818 - val_loss: 0.0824 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0835 - val_loss: 0.0877 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0795 - val_loss: 0.0925 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0815 - val_loss: 0.0980 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0796 - val_loss: 0.0764 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0737 - val_loss: 0.0728 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0730 - val_loss: 0.0735 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0710 - val_loss: 0.0722 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0706 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0690 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0673 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0665 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0658 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0656 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0656 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0649 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0642 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0640 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0636 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0638 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0637 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0638 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0637 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0639 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0641 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0639 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0639 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0639 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0639 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0639 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0639 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0639 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0639 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0639 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0604 - val_loss: 0.0639 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0639 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0639 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0639 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0639 - lr: 6.7729e-08
Average Validation Loss: 0.0856581375002861
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:36:39.509454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:39.509823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:39.510272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:39.562894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:39.563266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:39.563618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:39.643654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:39.644146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:39.644570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:39.704743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:39.705198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:39.705627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:39.938942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:39.939411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:39.939839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:39.999879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:40.000354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:40.000774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 65ms/step - loss: 0.2537 - val_loss: 0.2174 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1491
2023-11-26 16:36:40.563484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:40.564065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:40.564459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:40.625284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:40.625718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:40.626109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 8ms/step - loss: 0.1847 - val_loss: 0.1904 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1713 - val_loss: 0.1921 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1659 - val_loss: 0.1968 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1686 - val_loss: 0.1973 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1678 - val_loss: 0.1912 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1588 - val_loss: 0.1827 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1521 - val_loss: 0.1762 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1459 - val_loss: 0.1730 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1432 - val_loss: 0.1734 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1396 - val_loss: 0.1703 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1360 - val_loss: 0.1645 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1283 - val_loss: 0.1630 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1245 - val_loss: 0.1632 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1218 - val_loss: 0.1618 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1219 - val_loss: 0.1570 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1172 - val_loss: 0.1532 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1151 - val_loss: 0.1588 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1133 - val_loss: 0.1571 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1105 - val_loss: 0.1494 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1091 - val_loss: 0.1481 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1069 - val_loss: 0.1519 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1058 - val_loss: 0.1560 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1093 - val_loss: 0.1540 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1089 - val_loss: 0.1521 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1076 - val_loss: 0.1506 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1073 - val_loss: 0.1492 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1056 - val_loss: 0.1482 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1061 - val_loss: 0.1477 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1051 - val_loss: 0.1479 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1078 - val_loss: 0.1483 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1023 - val_loss: 0.1484 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1083 - val_loss: 0.1487 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1068 - val_loss: 0.1489 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1051 - val_loss: 0.1491 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1034 - val_loss: 0.1491 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1031 - val_loss: 0.1491 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1047 - val_loss: 0.1491 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1065 - val_loss: 0.1491 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1031 - val_loss: 0.1491 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1052 - val_loss: 0.1491 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1054 - val_loss: 0.1491 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1039 - val_loss: 0.1491 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1049 - val_loss: 0.1491 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1054 - val_loss: 0.1491 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1045 - val_loss: 0.1491 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1042 - val_loss: 0.1491 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1053 - val_loss: 0.1491 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1066 - val_loss: 0.1491 - lr: 6.7729e-08
Epoch 1/100
2023-11-26 16:36:42.397887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:42.398325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:42.398692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:42.450101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:42.450493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:42.450910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:42.534534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:42.535049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:42.535463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:42.594598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:42.595057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:42.595481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:42.830107: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:42.830562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:42.830989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:42.889614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:42.890068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:42.890485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - ETA: 0s - loss: 0.1875
2023-11-26 16:36:43.470529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:43.471149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:43.471601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 2s 86ms/step - loss: 0.1875 - val_loss: 0.1412 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1737 - val_loss: 0.1290 - lr: 0.0010
Epoch 3/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1641
2023-11-26 16:36:43.932324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:43.933048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:43.933458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1668 - val_loss: 0.1266 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1588 - val_loss: 0.1310 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1482 - val_loss: 0.1216 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1386 - val_loss: 0.1238 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1319 - val_loss: 0.1336 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1296 - val_loss: 0.1176 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1213 - val_loss: 0.1266 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1189 - val_loss: 0.1204 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1151 - val_loss: 0.1238 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1114 - val_loss: 0.1121 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1080 - val_loss: 0.1184 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1057 - val_loss: 0.1130 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1021 - val_loss: 0.1091 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1021 - val_loss: 0.1147 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1007 - val_loss: 0.1093 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0974 - val_loss: 0.0995 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0965 - val_loss: 0.1087 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0953 - val_loss: 0.1025 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0960 - val_loss: 0.1039 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0932 - val_loss: 0.1025 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0926 - val_loss: 0.0972 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.1013 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0913 - val_loss: 0.1040 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0931 - val_loss: 0.1026 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0915 - val_loss: 0.1006 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0910 - val_loss: 0.0984 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0917 - val_loss: 0.0987 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0905 - val_loss: 0.0995 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0922 - val_loss: 0.0995 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0911 - val_loss: 0.0993 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0909 - val_loss: 0.0988 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0923 - val_loss: 0.0988 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0919 - val_loss: 0.0992 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0897 - val_loss: 0.0994 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.0994 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0913 - val_loss: 0.0995 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0921 - val_loss: 0.0995 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0907 - val_loss: 0.0995 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0904 - val_loss: 0.0995 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0911 - val_loss: 0.0994 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0907 - val_loss: 0.0994 - lr: 7.4659e-07
Epoch 1/100
2023-11-26 16:36:46.202119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:46.202629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:46.203146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:46.255651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:46.256045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:46.256395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:46.338438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:46.338908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:46.339337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:46.398318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:46.398812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:46.399253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:46.634961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:46.635418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:46.635946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:46.694016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:46.694480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:46.694895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 26ms/step - loss: 0.1938 - val_loss: 0.1663 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1885
2023-11-26 16:36:47.314732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:47.315453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:47.315817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:47.377410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:47.377843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:47.378235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1664 - val_loss: 0.1593 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1572 - val_loss: 0.1559 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1492 - val_loss: 0.1468 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1437 - val_loss: 0.1406 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1403 - val_loss: 0.1321 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1341 - val_loss: 0.1218 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1300 - val_loss: 0.1177 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1254 - val_loss: 0.1093 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1242 - val_loss: 0.1068 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1177 - val_loss: 0.1028 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1163 - val_loss: 0.1024 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1110 - val_loss: 0.0973 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1083 - val_loss: 0.0959 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1075 - val_loss: 0.0958 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1038 - val_loss: 0.0939 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1052 - val_loss: 0.0939 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1007 - val_loss: 0.0917 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1005 - val_loss: 0.0899 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.0899 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0977 - val_loss: 0.0897 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0973 - val_loss: 0.0890 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.0885 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0959 - val_loss: 0.0873 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0958 - val_loss: 0.0879 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0969 - val_loss: 0.0883 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0879 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0930 - val_loss: 0.0877 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0937 - val_loss: 0.0875 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0871 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0946 - val_loss: 0.0869 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0935 - val_loss: 0.0868 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0937 - val_loss: 0.0866 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0930 - val_loss: 0.0866 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0868 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0925 - val_loss: 0.0870 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.0871 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0945 - val_loss: 0.0871 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0934 - val_loss: 0.0871 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0935 - val_loss: 0.0871 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0871 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.0871 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.0871 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0871 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0950 - val_loss: 0.0871 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0871 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0930 - val_loss: 0.0871 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.0871 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.0871 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0871 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0931 - val_loss: 0.0871 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.0871 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0937 - val_loss: 0.0871 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0871 - lr: 6.1442e-09
Epoch 1/100
2023-11-26 16:36:51.065727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:51.066150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:51.066751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:51.121540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:51.121918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:51.122247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:51.205475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:51.205946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:51.206371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:51.267312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:51.268158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:51.268713: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:51.505021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:51.505459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:51.505899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:51.563502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:51.563957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:51.564386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 20ms/step - loss: 0.2281 - val_loss: 0.1674 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1689
2023-11-26 16:36:52.185870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:52.186347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:52.187017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:52.248940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:52.249379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:52.249767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1737 - val_loss: 0.1633 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1664 - val_loss: 0.1498 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1512 - val_loss: 0.1439 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1440 - val_loss: 0.1417 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1367 - val_loss: 0.1356 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1315 - val_loss: 0.1386 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1263 - val_loss: 0.1323 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1214 - val_loss: 0.1294 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1171 - val_loss: 0.1279 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1145 - val_loss: 0.1195 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1084 - val_loss: 0.1185 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1073 - val_loss: 0.1165 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1052 - val_loss: 0.1099 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1012 - val_loss: 0.1074 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0989 - val_loss: 0.1080 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0983 - val_loss: 0.1017 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.0995 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0992 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.0950 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0932 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0917 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0872 - val_loss: 0.0891 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.0879 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0863 - val_loss: 0.0870 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0860 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0869 - val_loss: 0.0849 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0866 - val_loss: 0.0845 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0844 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.0843 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0836 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0832 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0832 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0830 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0829 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0829 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.0829 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0829 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0829 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.0829 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.0829 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.0828 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0828 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0828 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.0828 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0828 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0828 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.0828 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.0828 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0828 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0828 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0828 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.0828 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0828 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0828 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.0828 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0828 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0828 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0828 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.0828 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0828 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0828 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0828 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0828 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.0828 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0828 - lr: 8.3584e-12
Epoch 1/100
2023-11-26 16:36:57.818450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:57.818915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:57.819356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:57.870927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:57.871305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:57.871674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:57.952531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:57.953082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:57.953600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:58.015486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:58.015960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:58.016371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:58.259108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:58.259571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:58.260111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:58.318533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:58.318996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:58.319341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 16ms/step - loss: 0.1874 - val_loss: 0.1674 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2005
2023-11-26 16:36:58.947553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:58.947982: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:58.948399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:36:59.008747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:36:59.009207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:36:59.009604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 5ms/step - loss: 0.1668 - val_loss: 0.1559 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1529 - val_loss: 0.1493 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1431 - val_loss: 0.1424 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1376 - val_loss: 0.1378 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1297 - val_loss: 0.1305 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1224 - val_loss: 0.1203 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1140 - val_loss: 0.1129 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1091 - val_loss: 0.1116 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1059 - val_loss: 0.1096 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0998 - val_loss: 0.1027 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0977 - val_loss: 0.1026 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0975 - val_loss: 0.1063 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0960 - val_loss: 0.1071 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0947 - val_loss: 0.1020 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0900 - val_loss: 0.0958 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0869 - val_loss: 0.0918 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0912 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0887 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0844 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0820 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.0796 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0789 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0744 - val_loss: 0.0780 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0775 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0771 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0770 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0768 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0767 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0768 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0765 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0764 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0764 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0764 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0764 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0764 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0764 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0764 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0764 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0764 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0764 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0764 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0764 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0764 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0764 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0764 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0764 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0764 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0764 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0764 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0764 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0764 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0764 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0764 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0764 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0764 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0764 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0764 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0764 - lr: 5.0435e-10
Average Validation Loss: 0.09813913404941559
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:37:05.004044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:05.004447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:05.005025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:05.055649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:05.056044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:05.056475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:05.140711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:05.141215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:05.141660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:05.204294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:05.204811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:05.205247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:05.441359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:05.441826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:05.442502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:05.500763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:05.501231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:05.501669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.1773 - val_loss: 0.1862 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1342
2023-11-26 16:37:06.114294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:06.114777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:06.115267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:06.176363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:06.176791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:06.177175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1620 - val_loss: 0.1767 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1532 - val_loss: 0.1679 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1476 - val_loss: 0.1648 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1431 - val_loss: 0.1590 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1490 - val_loss: 0.1511 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1322 - val_loss: 0.1519 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1323 - val_loss: 0.1426 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1220 - val_loss: 0.1380 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1206 - val_loss: 0.1323 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1039 - val_loss: 0.1455 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1104 - val_loss: 0.1304 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0924 - val_loss: 0.1307 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0911 - val_loss: 0.1240 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0822 - val_loss: 0.1277 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0800 - val_loss: 0.1309 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0824 - val_loss: 0.1211 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0786 - val_loss: 0.1203 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.1218 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0746 - val_loss: 0.1195 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.1206 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.1198 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.1186 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.1191 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.1232 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.1199 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.1205 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.1200 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.1197 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.1185 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0696 - val_loss: 0.1183 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.1188 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.1179 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0687 - val_loss: 0.1183 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.1186 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0691 - val_loss: 0.1188 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.1190 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.1191 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.1191 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.1191 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.1191 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.1191 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.1191 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.1191 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.1191 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.1191 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.1191 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0692 - val_loss: 0.1191 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.1191 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.1191 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.1191 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.1191 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.1191 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:37:09.941130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:09.941500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:09.941876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:09.995682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:09.996114: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:09.996461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:10.079472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:10.079962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:10.080395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:10.138872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:10.139331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:10.139745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:10.320199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:10.320662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:10.321094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:10.377674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:10.378134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:10.378555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.1865 - val_loss: 0.1174 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1446
2023-11-26 16:37:10.862656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:10.863421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:10.864182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:10.936095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:10.936892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:10.937346: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1685 - val_loss: 0.1169 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1590 - val_loss: 0.1062 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1518 - val_loss: 0.1041 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1467 - val_loss: 0.1009 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1404 - val_loss: 0.0998 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1396 - val_loss: 0.0943 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1340 - val_loss: 0.0980 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1312 - val_loss: 0.0866 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1276 - val_loss: 0.0959 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1226 - val_loss: 0.0860 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1188 - val_loss: 0.0975 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1158 - val_loss: 0.0847 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1101 - val_loss: 0.0960 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1057 - val_loss: 0.0910 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1037 - val_loss: 0.0864 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0993 - val_loss: 0.0853 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0926 - val_loss: 0.0895 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0917 - val_loss: 0.0866 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0870 - val_loss: 0.0853 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0842 - val_loss: 0.0814 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0844 - val_loss: 0.0813 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0810 - val_loss: 0.0823 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0795 - val_loss: 0.0793 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0850 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0799 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0785 - val_loss: 0.0812 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0822 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.0836 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0826 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0832 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0828 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0819 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.0826 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0831 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0744 - val_loss: 0.0834 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0835 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0743 - val_loss: 0.0835 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0751 - val_loss: 0.0835 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0834 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0834 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0833 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0833 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0768 - val_loss: 0.0833 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:37:14.971740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:14.972477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:14.972830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:15.024795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:15.025158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:15.025490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:15.107565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:15.108053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:15.108474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:15.168614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:15.169062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:15.169489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:15.405720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:15.406175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:15.406726: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:15.464112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:15.464565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:15.464992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 2s 8ms/step - loss: 0.1710 - val_loss: 0.1584 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1292
2023-11-26 16:37:16.565914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:16.566427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:16.566848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:16.629051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:16.629535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:16.629939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1521 - val_loss: 0.1462 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1413 - val_loss: 0.1353 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1348 - val_loss: 0.1275 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1297 - val_loss: 0.1231 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1264 - val_loss: 0.1194 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1212 - val_loss: 0.1165 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1192 - val_loss: 0.1132 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1140 - val_loss: 0.1112 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1131 - val_loss: 0.1096 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1121 - val_loss: 0.1066 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.1041 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1015 - val_loss: 0.0978 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0934 - val_loss: 0.0898 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0913 - val_loss: 0.0888 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0857 - val_loss: 0.0758 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0836 - val_loss: 0.0792 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0784 - val_loss: 0.0713 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0763 - val_loss: 0.0728 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0736 - val_loss: 0.0662 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0710 - val_loss: 0.0661 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0640 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0626 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0626 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0663 - val_loss: 0.0608 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0663 - val_loss: 0.0605 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0602 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0598 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0601 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0644 - val_loss: 0.0608 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0611 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0644 - val_loss: 0.0610 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0610 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0612 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0611 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0611 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0611 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0612 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0613 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0613 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0612 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0612 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0612 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0612 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0612 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0612 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0612 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0612 - lr: 1.0104e-07
Epoch 1/100
2023-11-26 16:37:24.303709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:24.304195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:24.304610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:24.357567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:24.357938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:24.358284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:24.437099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:24.437573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:24.437986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:24.497257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:24.497734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:24.498142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:24.737079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:24.737636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:24.738046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:24.796281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:24.796737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:24.797157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1663 - val_loss: 0.1494 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1495
2023-11-26 16:37:25.554593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:25.555088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:25.555771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:25.618537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:25.618968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:25.619344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1456 - val_loss: 0.1380 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1349 - val_loss: 0.1284 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1270 - val_loss: 0.1215 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1218 - val_loss: 0.1150 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1167 - val_loss: 0.1183 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1135 - val_loss: 0.1169 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1081 - val_loss: 0.1082 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1052 - val_loss: 0.1059 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1020 - val_loss: 0.1024 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0970 - val_loss: 0.1012 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0941 - val_loss: 0.0981 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0893 - val_loss: 0.0960 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0873 - val_loss: 0.0893 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0828 - val_loss: 0.0919 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0796 - val_loss: 0.0885 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0866 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0858 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0731 - val_loss: 0.0827 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0727 - val_loss: 0.0808 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0812 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0686 - val_loss: 0.0758 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0785 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0736 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0729 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0662 - val_loss: 0.0682 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0652 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0644 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0627 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0608 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0601 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0597 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0595 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0592 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0592 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0591 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0592 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0591 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0591 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0591 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0591 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0591 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0591 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0591 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0591 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0591 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0591 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0591 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0591 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0591 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0591 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0591 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0591 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0591 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0591 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0591 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0591 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0591 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0591 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0591 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0591 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0591 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0591 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0591 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0591 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0591 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0591 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0591 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0591 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0591 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0591 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0591 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0591 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0591 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0591 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0591 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0591 - lr: 2.8039e-15
Epoch 1/100
2023-11-26 16:37:41.044568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:41.045106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:41.045560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:41.099218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:41.099606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:41.099949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:41.178888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:41.179408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:41.179883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:41.239648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:41.240118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:41.240543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:41.475223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:41.475826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:41.476259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:41.534044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:41.534527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:41.534945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1662 - val_loss: 0.1425 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0915
2023-11-26 16:37:42.340816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:42.341599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:42.342073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:42.403496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:42.404077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:42.404501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1373 - val_loss: 0.1306 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1198 - val_loss: 0.1235 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1083 - val_loss: 0.1155 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1054 - val_loss: 0.1110 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0959 - val_loss: 0.1051 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0889 - val_loss: 0.1025 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0832 - val_loss: 0.0966 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0790 - val_loss: 0.0932 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0929 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0764 - val_loss: 0.0899 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0877 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.0956 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0872 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0898 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0868 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0643 - val_loss: 0.0834 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0807 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0794 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0787 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0775 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0721 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0705 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0698 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0682 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0680 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0676 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0665 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0664 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0660 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0656 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0656 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0654 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0653 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0652 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0652 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0652 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0652 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0652 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0652 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0652 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0652 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0652 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0652 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0652 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0652 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0652 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0652 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0652 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0652 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0652 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0652 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0652 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0652 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0652 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0652 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0652 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0652 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0652 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0652 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0652 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0652 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0652 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0652 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0652 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0652 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0652 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0652 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0652 - lr: 1.3816e-12
Average Validation Loss: 0.07626665532588958
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 16:37:59.308762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:59.309199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:59.309576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:59.362920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:59.363314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:59.363666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:59.445647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:59.446156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:59.446581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:59.508743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:59.509225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:59.509644: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:59.757693: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:59.758333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:59.758761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:37:59.817558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:37:59.818021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:37:59.818363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1759 - val_loss: 0.1832 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1298
2023-11-26 16:38:00.418542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:00.419041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:00.419704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:00.480510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:00.480931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:00.481547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 5ms/step - loss: 0.1614 - val_loss: 0.1905 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1633 - val_loss: 0.1705 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1588 - val_loss: 0.1595 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1518 - val_loss: 0.1575 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1476 - val_loss: 0.1552 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1425 - val_loss: 0.1530 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1394 - val_loss: 0.1456 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1296 - val_loss: 0.1428 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1246 - val_loss: 0.1356 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1108 - val_loss: 0.1351 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1075 - val_loss: 0.1324 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0983 - val_loss: 0.1350 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0956 - val_loss: 0.1361 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0935 - val_loss: 0.1307 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.1361 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.1285 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.1300 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0875 - val_loss: 0.1286 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0864 - val_loss: 0.1326 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.1261 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0860 - val_loss: 0.1301 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.1328 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.1265 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.1267 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.1282 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.1266 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.1265 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.1260 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.1256 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1257 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.1259 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.1261 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.1264 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1266 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.1268 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.1268 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.1268 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1267 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1267 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.1267 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1267 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1267 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1267 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1267 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.1267 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.1267 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.1267 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.1267 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1267 - lr: 4.5400e-08
Epoch 1/100
2023-11-26 16:38:02.875672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:02.876118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:02.876677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:02.928127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:02.928521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:02.928847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:03.007068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:03.007533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:03.007960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:03.066233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:03.066701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:03.067097: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:03.260647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:03.261286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:03.261722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:03.325883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:03.326396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:03.326808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.1944 - val_loss: 0.1277 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1274
2023-11-26 16:38:03.802747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:03.803439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:03.804062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:03.867285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:03.867741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:03.868119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 3ms/step - loss: 0.1668 - val_loss: 0.1294 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1559 - val_loss: 0.1164 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1457 - val_loss: 0.1045 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1359 - val_loss: 0.1012 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1284 - val_loss: 0.0988 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1227 - val_loss: 0.0962 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1190 - val_loss: 0.0906 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1125 - val_loss: 0.0873 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1064 - val_loss: 0.0909 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0997 - val_loss: 0.0836 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0995 - val_loss: 0.0796 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0957 - val_loss: 0.0840 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0932 - val_loss: 0.0875 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0891 - val_loss: 0.0832 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0893 - val_loss: 0.0826 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0868 - val_loss: 0.0803 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.0787 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0843 - val_loss: 0.0819 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0830 - val_loss: 0.0831 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0820 - val_loss: 0.0795 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0802 - val_loss: 0.0810 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0801 - val_loss: 0.0796 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0802 - val_loss: 0.0784 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0814 - val_loss: 0.0802 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0805 - val_loss: 0.0771 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0781 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0793 - val_loss: 0.0779 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0783 - val_loss: 0.0792 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0779 - val_loss: 0.0801 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0795 - val_loss: 0.0800 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0796 - val_loss: 0.0792 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0783 - val_loss: 0.0797 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0776 - val_loss: 0.0799 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0777 - val_loss: 0.0803 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0805 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0805 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0804 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0804 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0790 - val_loss: 0.0804 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0777 - val_loss: 0.0803 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0803 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0780 - val_loss: 0.0804 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0779 - val_loss: 0.0803 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0803 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0803 - lr: 2.2487e-07
Epoch 1/100
2023-11-26 16:38:06.591625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:06.592148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:06.592714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:06.643721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:06.644101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:06.644446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:06.724504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:06.724974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:06.725379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:06.784349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:06.784825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:06.785237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:07.023600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:07.024059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:07.024753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:07.083537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:07.083985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:07.084358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 14ms/step - loss: 0.1667 - val_loss: 0.1606 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1199
2023-11-26 16:38:07.732289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:07.732701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:07.733104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:07.794818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:07.795281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:07.795662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.1496 - val_loss: 0.1470 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1374 - val_loss: 0.1340 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1294 - val_loss: 0.1202 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1236 - val_loss: 0.1102 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1179 - val_loss: 0.1014 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1116 - val_loss: 0.0957 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1062 - val_loss: 0.0934 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1021 - val_loss: 0.0904 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0991 - val_loss: 0.0870 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0958 - val_loss: 0.0860 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0966 - val_loss: 0.0857 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0964 - val_loss: 0.0789 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0891 - val_loss: 0.0756 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0858 - val_loss: 0.0751 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0848 - val_loss: 0.0737 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0852 - val_loss: 0.0709 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0838 - val_loss: 0.0683 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0807 - val_loss: 0.0667 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0667 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0641 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0634 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0639 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.0628 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0623 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.0624 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0627 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0619 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0621 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0627 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0621 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0693 - val_loss: 0.0623 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.0619 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0616 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0617 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0689 - val_loss: 0.0618 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0617 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0617 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0617 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.0618 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.0618 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0618 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0618 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0618 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0618 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0618 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0618 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0618 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0618 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.0618 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0687 - val_loss: 0.0618 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.0618 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0618 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0618 - lr: 6.1442e-09
Epoch 1/100
2023-11-26 16:38:13.052927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:13.053488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:13.053943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:13.105021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:13.105419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:13.105751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:13.187579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:13.188056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:13.188500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:13.247109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:13.247569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:13.247996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:13.892315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:13.892997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:13.893704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:13.951939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:13.952403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:13.952818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 2s 11ms/step - loss: 0.1770 - val_loss: 0.1561 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1225
2023-11-26 16:38:14.634106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:14.634678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:14.635241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:14.698430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:14.698860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:14.699173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.1499 - val_loss: 0.1544 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1408 - val_loss: 0.1503 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1301 - val_loss: 0.1519 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1243 - val_loss: 0.1410 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1181 - val_loss: 0.1380 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1122 - val_loss: 0.1326 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1079 - val_loss: 0.1370 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1081 - val_loss: 0.1327 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1028 - val_loss: 0.1304 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1053 - val_loss: 0.1376 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1006 - val_loss: 0.1229 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0979 - val_loss: 0.1358 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1015 - val_loss: 0.1302 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1029 - val_loss: 0.1237 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0998 - val_loss: 0.1148 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0970 - val_loss: 0.1097 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0923 - val_loss: 0.1146 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0920 - val_loss: 0.1094 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0918 - val_loss: 0.1076 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0900 - val_loss: 0.1011 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0859 - val_loss: 0.0988 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0848 - val_loss: 0.0930 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0825 - val_loss: 0.0944 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0819 - val_loss: 0.0905 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0798 - val_loss: 0.0892 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0793 - val_loss: 0.0907 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0803 - val_loss: 0.0895 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0803 - val_loss: 0.0883 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0805 - val_loss: 0.0878 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0794 - val_loss: 0.0882 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0876 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0798 - val_loss: 0.0875 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0798 - val_loss: 0.0874 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0870 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0870 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0789 - val_loss: 0.0870 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0794 - val_loss: 0.0871 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0802 - val_loss: 0.0870 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0784 - val_loss: 0.0869 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0794 - val_loss: 0.0869 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0790 - val_loss: 0.0869 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0793 - val_loss: 0.0869 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0786 - val_loss: 0.0869 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0788 - val_loss: 0.0869 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.0869 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0776 - val_loss: 0.0869 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0802 - val_loss: 0.0869 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0869 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0869 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0786 - val_loss: 0.0869 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0792 - val_loss: 0.0869 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0786 - val_loss: 0.0869 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0788 - val_loss: 0.0869 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0869 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0796 - val_loss: 0.0869 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0869 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0792 - val_loss: 0.0869 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0779 - val_loss: 0.0869 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0869 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0784 - val_loss: 0.0869 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0869 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0784 - val_loss: 0.0869 - lr: 5.0565e-11
Epoch 1/100
2023-11-26 16:38:22.431425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:22.431980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:22.432550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:22.488219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:22.488609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:22.488949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:22.569746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:22.570225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:22.570646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:22.630537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:22.630982: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:22.631408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:22.866713: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:22.867169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:22.867605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:22.927043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:22.927788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:22.928460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 10ms/step - loss: 0.1737 - val_loss: 0.1455 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1082
2023-11-26 16:38:23.631599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:23.632164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:23.632562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:23.695468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:23.695890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:23.696245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.1428 - val_loss: 0.1243 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1271 - val_loss: 0.1154 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1140 - val_loss: 0.1101 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1061 - val_loss: 0.1053 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1025 - val_loss: 0.1023 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0992 - val_loss: 0.0997 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0944 - val_loss: 0.0969 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0918 - val_loss: 0.0946 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0885 - val_loss: 0.0933 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0879 - val_loss: 0.0891 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0828 - val_loss: 0.0860 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0797 - val_loss: 0.0859 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0835 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0801 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0728 - val_loss: 0.0795 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0768 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0768 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0765 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0749 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0740 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0734 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0739 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0638 - val_loss: 0.0741 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0743 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0754 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0752 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0646 - val_loss: 0.0720 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0708 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0625 - val_loss: 0.0695 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0692 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0687 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0685 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0685 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0684 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0684 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0684 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0683 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0683 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0682 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0682 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0682 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0682 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0682 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0682 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0682 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0682 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0682 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0682 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0682 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0682 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0682 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0682 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0682 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0682 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0682 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0682 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0682 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0682 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0682 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0682 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0682 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0682 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0682 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0682 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0682 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0682 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0682 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0682 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0682 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0682 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0682 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0682 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0682 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0682 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0682 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0604 - val_loss: 0.0682 - lr: 5.6464e-15
Average Validation Loss: 0.08390068113803864
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 16:38:35.229181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:35.229702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:35.230157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:35.282443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:35.282815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:35.283183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:35.363040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:35.363507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:35.363921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:35.423473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:35.423919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:35.424337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:35.671506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:35.671965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:35.672398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:35.731990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:35.732473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:35.732891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 68ms/step - loss: 0.2037 - val_loss: 0.1815 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1410
2023-11-26 16:38:36.290304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:36.290761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:36.291180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:36.357197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:36.357750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:36.358506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 9ms/step - loss: 0.1681 - val_loss: 0.1754 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1554 - val_loss: 0.1784 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1556 - val_loss: 0.1803 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1593 - val_loss: 0.1797 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1555 - val_loss: 0.1766 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1525 - val_loss: 0.1719 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1484 - val_loss: 0.1659 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1425 - val_loss: 0.1617 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1317 - val_loss: 0.1603 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1283 - val_loss: 0.1616 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1245 - val_loss: 0.1615 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1215 - val_loss: 0.1603 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1151 - val_loss: 0.1582 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1126 - val_loss: 0.1566 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1090 - val_loss: 0.1552 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1048 - val_loss: 0.1557 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1026 - val_loss: 0.1579 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1014 - val_loss: 0.1605 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1023 - val_loss: 0.1595 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1032 - val_loss: 0.1578 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1007 - val_loss: 0.1588 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1003 - val_loss: 0.1595 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0972 - val_loss: 0.1589 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0980 - val_loss: 0.1589 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0981 - val_loss: 0.1589 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0993 - val_loss: 0.1582 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0968 - val_loss: 0.1576 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0997 - val_loss: 0.1571 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0973 - val_loss: 0.1567 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0977 - val_loss: 0.1567 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0988 - val_loss: 0.1568 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0977 - val_loss: 0.1569 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0965 - val_loss: 0.1570 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0959 - val_loss: 0.1570 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0998 - val_loss: 0.1569 - lr: 8.2297e-06
Epoch 1/100
2023-11-26 16:38:37.726875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:37.727499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:37.727928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:37.780142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:37.780543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:37.780895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:37.867128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:37.867551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:37.867952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:37.930743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:37.931285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:37.931737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:38.180732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:38.181186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:38.181645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:38.241260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:38.241742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:38.242178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.2510 - val_loss: 0.2079 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1352
2023-11-26 16:38:38.843985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:38.844444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:38.844844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:38.908083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:38.908550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:38.908933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1832 - val_loss: 0.1409 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1754 - val_loss: 0.1310 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1686 - val_loss: 0.1256 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1568 - val_loss: 0.1297 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1521 - val_loss: 0.1243 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1442 - val_loss: 0.1129 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1370 - val_loss: 0.1107 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1295 - val_loss: 0.1097 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1263 - val_loss: 0.1083 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1205 - val_loss: 0.1063 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1164 - val_loss: 0.1046 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1096 - val_loss: 0.1022 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1076 - val_loss: 0.1036 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1051 - val_loss: 0.1029 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1067 - val_loss: 0.1018 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1035 - val_loss: 0.1046 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1005 - val_loss: 0.0986 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0986 - val_loss: 0.1084 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1002 - val_loss: 0.0873 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.1046 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0999 - val_loss: 0.0947 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0971 - val_loss: 0.0997 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0962 - val_loss: 0.1024 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0957 - val_loss: 0.0982 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0935 - val_loss: 0.0949 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0945 - val_loss: 0.0953 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.0965 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0982 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0931 - val_loss: 0.0982 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0942 - val_loss: 0.0973 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0954 - val_loss: 0.0967 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0948 - val_loss: 0.0971 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0931 - val_loss: 0.0977 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0942 - val_loss: 0.0975 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0934 - val_loss: 0.0974 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0922 - val_loss: 0.0974 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0922 - val_loss: 0.0974 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0929 - val_loss: 0.0974 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0942 - val_loss: 0.0974 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:38:40.992415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:40.992844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:40.993271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:41.044557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:41.044919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:41.045314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:41.141200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:41.141646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:41.142074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:41.207151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:41.207893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:41.208357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:41.454767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:41.455236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:41.455688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:41.516592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:41.517111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:41.517551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 26ms/step - loss: 0.1808 - val_loss: 0.1726 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1716
2023-11-26 16:38:42.143240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:42.144014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:42.144478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:42.206807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:42.207241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:42.207625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1620 - val_loss: 0.1717 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1525 - val_loss: 0.1652 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1435 - val_loss: 0.1540 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1408 - val_loss: 0.1489 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1344 - val_loss: 0.1425 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1299 - val_loss: 0.1374 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1229 - val_loss: 0.1294 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1195 - val_loss: 0.1242 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1167 - val_loss: 0.1192 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1128 - val_loss: 0.1164 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1096 - val_loss: 0.1148 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1048 - val_loss: 0.1100 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1024 - val_loss: 0.1076 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1029 - val_loss: 0.1074 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.1045 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0981 - val_loss: 0.1029 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0964 - val_loss: 0.1019 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0947 - val_loss: 0.1015 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0998 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.0988 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0929 - val_loss: 0.0978 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0911 - val_loss: 0.0973 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.0972 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.0971 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.0968 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0884 - val_loss: 0.0964 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.0966 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.0966 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.0961 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0902 - val_loss: 0.0960 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0899 - val_loss: 0.0960 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0959 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0890 - val_loss: 0.0960 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0890 - val_loss: 0.0959 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0901 - val_loss: 0.0958 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.0958 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0883 - val_loss: 0.0957 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0957 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0957 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0957 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0957 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0957 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0957 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0893 - val_loss: 0.0957 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0880 - val_loss: 0.0957 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0875 - val_loss: 0.0957 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0889 - val_loss: 0.0957 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0866 - val_loss: 0.0957 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0957 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0884 - val_loss: 0.0957 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0884 - val_loss: 0.0957 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0866 - val_loss: 0.0957 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0957 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0957 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0894 - val_loss: 0.0957 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0885 - val_loss: 0.0957 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.0957 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0957 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0957 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0957 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0957 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.0957 - lr: 5.0565e-11
Epoch 64/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.0957 - lr: 2.7751e-11
Epoch 65/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.0957 - lr: 1.5230e-11
Epoch 66/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0889 - val_loss: 0.0957 - lr: 8.3584e-12
Epoch 67/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0883 - val_loss: 0.0957 - lr: 4.5872e-12
Epoch 68/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0957 - lr: 2.5175e-12
Epoch 69/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.0957 - lr: 1.3816e-12
Epoch 70/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0957 - lr: 7.5826e-13
Epoch 71/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0867 - val_loss: 0.0957 - lr: 3.7654e-13
Epoch 72/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0872 - val_loss: 0.0957 - lr: 1.8698e-13
Epoch 73/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0957 - lr: 9.2853e-14
Epoch 74/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0957 - lr: 4.6110e-14
Epoch 75/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0878 - val_loss: 0.0957 - lr: 2.2897e-14
Epoch 76/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0957 - lr: 1.1370e-14
Epoch 1/100
2023-11-26 16:38:47.366726: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:47.367271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:47.367869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:47.422527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:47.422925: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:47.423277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:47.506641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:47.507116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:47.507566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:47.567926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:47.568375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:47.569118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:47.820707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:47.821468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:47.821988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:47.884351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:47.884815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:47.885254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 20ms/step - loss: 0.1913 - val_loss: 0.1537 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1556
2023-11-26 16:38:48.522209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:48.522684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:48.523364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:48.590624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:48.591444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:48.592162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1609 - val_loss: 0.1439 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1427 - val_loss: 0.1418 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1323 - val_loss: 0.1248 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1234 - val_loss: 0.1360 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1219 - val_loss: 0.1302 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1181 - val_loss: 0.1022 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1072 - val_loss: 0.1094 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1060 - val_loss: 0.1134 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1058 - val_loss: 0.0988 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0976 - val_loss: 0.0977 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0956 - val_loss: 0.0950 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0933 - val_loss: 0.0877 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.0851 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0768 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.0778 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0778 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0735 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.0740 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0741 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.0729 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0713 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0722 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0716 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0705 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.0721 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0712 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.0704 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0709 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.0703 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0704 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0703 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0702 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0701 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0702 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0702 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0702 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.0702 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0790 - val_loss: 0.0702 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0784 - val_loss: 0.0702 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.0702 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0702 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0784 - val_loss: 0.0702 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0784 - val_loss: 0.0702 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0702 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.0702 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0702 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0702 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0702 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.0702 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.0702 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0702 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.0702 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.0702 - lr: 6.1442e-09
Epoch 1/100
2023-11-26 16:38:53.109072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:53.109446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:53.109855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:53.162238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:53.162619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:53.163026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:53.245444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:53.245891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:53.246357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:53.734457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:53.735313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:53.735850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:53.988162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:53.988706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:53.989378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:54.047305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:54.047756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:54.048184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 2s 16ms/step - loss: 0.1965 - val_loss: 0.1563 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1914
2023-11-26 16:38:54.692779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:54.693265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:54.693931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:38:54.754667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:38:54.755128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:38:54.755516: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 5ms/step - loss: 0.1630 - val_loss: 0.1461 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1469 - val_loss: 0.1408 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1402 - val_loss: 0.1342 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1314 - val_loss: 0.1286 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1269 - val_loss: 0.1243 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1239 - val_loss: 0.1236 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1214 - val_loss: 0.1202 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1164 - val_loss: 0.1152 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1108 - val_loss: 0.1132 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1079 - val_loss: 0.1091 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1052 - val_loss: 0.1111 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1030 - val_loss: 0.1082 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0998 - val_loss: 0.1058 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0958 - val_loss: 0.1008 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0935 - val_loss: 0.0990 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.1001 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0975 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.0960 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.0923 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0908 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.0890 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0874 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0861 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.0853 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.0835 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0835 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0825 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0823 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0817 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0815 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0815 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0812 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.0810 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0809 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0809 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0809 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.0808 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0808 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0808 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0808 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0808 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0808 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0808 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0808 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0808 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0808 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0808 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0808 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0808 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0808 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0808 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0808 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0808 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0808 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0808 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0808 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0808 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.0808 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0808 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0808 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.0808 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0808 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0808 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0808 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0808 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0808 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0808 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0808 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0808 - lr: 5.6464e-15
Average Validation Loss: 0.09780584573745728
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:39:02.689074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:02.689639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:02.689976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:02.741743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:02.742151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:02.742508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:02.830468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:02.831266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:02.832026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:02.896463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:02.896999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:02.897422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:03.132981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:03.133441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:03.133968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:03.192143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:03.192601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:03.193022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.1336 - val_loss: 0.1384 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0647
2023-11-26 16:39:03.830577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:03.831048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:03.831698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:03.893482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:03.893901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:03.894279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1183 - val_loss: 0.1287 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1123 - val_loss: 0.1223 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1058 - val_loss: 0.1248 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1060 - val_loss: 0.1194 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1005 - val_loss: 0.1181 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0965 - val_loss: 0.1149 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0941 - val_loss: 0.1127 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0895 - val_loss: 0.1133 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0803 - val_loss: 0.1101 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0756 - val_loss: 0.1016 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.1010 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.1051 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.1051 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0926 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.1095 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.1031 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0542 - val_loss: 0.1021 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0965 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.1048 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.1009 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.1058 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0976 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.1010 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0988 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0966 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0963 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0988 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.1025 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.1021 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.1017 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.1029 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.1020 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.1014 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.1003 - lr: 1.1109e-05
Epoch 1/100
2023-11-26 16:39:06.361712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:06.362137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:06.362722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:06.414487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:06.414856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:06.415165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:06.497716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:06.498357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:06.498843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:06.559523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:06.559992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:06.560405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:06.747648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:06.748960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:06.749634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:06.812719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:06.813191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:06.813535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1525 - val_loss: 0.0839 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1144
2023-11-26 16:39:07.301039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:07.301461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:07.301847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:07.364815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:07.365285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:07.365682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1305 - val_loss: 0.0854 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1247 - val_loss: 0.0748 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1205 - val_loss: 0.0782 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1178 - val_loss: 0.0740 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1156 - val_loss: 0.0758 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1139 - val_loss: 0.0705 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1114 - val_loss: 0.0698 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1066 - val_loss: 0.0760 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1044 - val_loss: 0.0680 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0988 - val_loss: 0.0798 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0936 - val_loss: 0.0674 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0924 - val_loss: 0.0719 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0852 - val_loss: 0.0707 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0843 - val_loss: 0.0686 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0765 - val_loss: 0.0674 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0736 - val_loss: 0.0660 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0667 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0661 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0660 - val_loss: 0.0621 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0625 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0660 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0651 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0663 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0685 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0678 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0665 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0683 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0670 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0681 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0543 - val_loss: 0.0677 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0680 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0681 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0681 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0677 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0676 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0679 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0545 - val_loss: 0.0678 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0680 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:39:10.952084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:10.952461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:10.953070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:11.003704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:11.004085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:11.004418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:11.094395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:11.094954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:11.095446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:11.160854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:11.161391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:11.162064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:11.423317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:11.424330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:11.424911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:11.485830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:11.486342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:11.486793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 8ms/step - loss: 0.1216 - val_loss: 0.1133 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0736
2023-11-26 16:39:12.192087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:12.192588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:12.193071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:12.255258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:12.255722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:12.256123: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1088 - val_loss: 0.0991 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1037 - val_loss: 0.0968 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1001 - val_loss: 0.0942 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0932 - val_loss: 0.0916 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0919 - val_loss: 0.0881 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0849 - val_loss: 0.0811 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0868 - val_loss: 0.0845 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0806 - val_loss: 0.0760 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0805 - val_loss: 0.0768 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0756 - val_loss: 0.0723 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0613 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0667 - val_loss: 0.0650 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0571 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0551 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0546 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0519 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0516 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0506 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0512 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0486 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0477 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0474 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0476 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0482 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0488 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0494 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0499 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0488 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0490 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0489 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0491 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0489 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0489 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0488 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0487 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0488 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0488 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0489 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0489 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0489 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0489 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0489 - lr: 7.4659e-07
Epoch 1/100
2023-11-26 16:39:18.946437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:18.947119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:18.947526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:18.999964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:19.000350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:19.000697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:19.082144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:19.082631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:19.083048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:19.142867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:19.143329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:19.143810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:19.378949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:19.379678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:19.380271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:19.449365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:19.449868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:19.450312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1206 - val_loss: 0.1149 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1168
2023-11-26 16:39:20.214294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:20.214995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:20.215451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:20.280859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:20.281289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:20.281675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1130 - val_loss: 0.1088 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1058 - val_loss: 0.1079 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1050 - val_loss: 0.1007 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0993 - val_loss: 0.0875 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0960 - val_loss: 0.0904 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0903 - val_loss: 0.0842 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0874 - val_loss: 0.0798 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0849 - val_loss: 0.0779 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0793 - val_loss: 0.0772 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0841 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0856 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0660 - val_loss: 0.0811 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0719 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0674 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0661 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0592 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0615 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0577 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0603 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0580 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0580 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0612 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0596 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0610 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0574 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0564 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0533 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0518 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0509 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0505 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0498 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0496 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0494 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0493 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0492 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0492 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0492 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0491 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0491 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0491 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0491 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0491 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0491 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0491 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0491 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0491 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0491 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0491 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0491 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0491 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0491 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0491 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0491 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0491 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0491 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0491 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0491 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0491 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0491 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0491 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0491 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0491 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0491 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0491 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0491 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0491 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0491 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0491 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0491 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0491 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0491 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0491 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 5.6464e-15
Epoch 1/100
2023-11-26 16:39:35.504794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:35.505219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:35.505818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:35.557511: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:35.557879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:35.558228: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:35.644040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:35.644882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:35.645776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:35.710656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:35.711253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:35.711691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:35.953398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:35.953881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:35.954340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:36.015428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:36.015915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:36.016358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1259 - val_loss: 0.1004 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0484
2023-11-26 16:39:36.849724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:36.850177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:36.850678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:36.913224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:36.913702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:36.914129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1074 - val_loss: 0.0927 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1016 - val_loss: 0.0890 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0930 - val_loss: 0.0828 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0847 - val_loss: 0.0804 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0844 - val_loss: 0.0789 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0761 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0768 - val_loss: 0.0735 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0756 - val_loss: 0.0724 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0779 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0778 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0659 - val_loss: 0.0782 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0804 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0779 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0747 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0741 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0715 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0719 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0698 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0664 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0654 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0653 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0644 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0651 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0648 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0652 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0648 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0645 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0639 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0638 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0637 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0637 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0637 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0637 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0637 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0637 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0638 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0638 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0638 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0638 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0638 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0638 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0638 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0638 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0638 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0638 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0638 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0638 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0638 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0445 - val_loss: 0.0638 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0638 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0638 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0638 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0638 - lr: 2.2603e-09
Average Validation Loss: 0.06297357231378556
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
2023-11-26 16:39:50.463859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:50.464276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:50.464897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:50.517408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:50.517771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:50.518112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
Epoch 1/100
2023-11-26 16:39:51.069657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:51.070843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:51.071381: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:51.135325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:51.135841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:51.136459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:51.377190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:51.377662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:51.378238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:51.437440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:51.437901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:51.438323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.1747 - val_loss: 0.1469 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1071
2023-11-26 16:39:52.028935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:52.029430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:52.030176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:52.096700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:52.097337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:52.097789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 5ms/step - loss: 0.1240 - val_loss: 0.1340 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1189 - val_loss: 0.1353 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1127 - val_loss: 0.1339 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1111 - val_loss: 0.1301 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1083 - val_loss: 0.1262 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1064 - val_loss: 0.1229 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1021 - val_loss: 0.1207 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1045 - val_loss: 0.1197 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0974 - val_loss: 0.1172 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0955 - val_loss: 0.1159 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.1114 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.1086 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1059 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0784 - val_loss: 0.1050 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.1040 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.1026 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0674 - val_loss: 0.1006 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0675 - val_loss: 0.0988 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.1001 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0974 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0965 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0959 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0964 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0969 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0963 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0592 - val_loss: 0.0968 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0966 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0962 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0957 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0576 - val_loss: 0.0958 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0957 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0956 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0955 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0955 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0955 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0956 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0957 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0957 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0957 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0957 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0957 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0957 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0957 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0564 - val_loss: 0.0957 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0569 - val_loss: 0.0957 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0571 - val_loss: 0.0957 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0957 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0957 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0957 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0957 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0957 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0957 - lr: 1.0130e-08
Epoch 54/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0957 - lr: 6.1442e-09
Epoch 55/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0957 - lr: 3.7267e-09
Epoch 56/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0957 - lr: 2.2603e-09
Epoch 1/100
2023-11-26 16:39:54.828097: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:54.828562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:54.828915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:54.884581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:54.885016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:54.885394: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:54.966820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:54.967318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:54.967738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:55.026930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:55.027430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:55.027855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:55.220921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:55.221908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:55.222431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:55.284738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:55.285209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:55.285758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.1491 - val_loss: 0.0825 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0642
2023-11-26 16:39:55.759214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:55.759637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:55.760040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:55.825294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:55.825773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:55.826130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 3ms/step - loss: 0.1255 - val_loss: 0.0753 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1192 - val_loss: 0.0776 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1149 - val_loss: 0.0751 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1108 - val_loss: 0.0701 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1085 - val_loss: 0.0714 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1046 - val_loss: 0.0767 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0980 - val_loss: 0.0780 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0959 - val_loss: 0.0826 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0932 - val_loss: 0.0760 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0892 - val_loss: 0.0815 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0810 - val_loss: 0.0842 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0795 - val_loss: 0.0814 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0809 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0779 - val_loss: 0.0817 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0756 - val_loss: 0.0783 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.0797 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0719 - val_loss: 0.0779 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0809 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0748 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0758 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0815 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0793 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0817 - lr: 1.3534e-04
Epoch 1/100
2023-11-26 16:39:57.379272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:57.379854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:57.380195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:57.437359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:57.437821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:57.438190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:57.522479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:57.523043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:57.523555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:57.591375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:57.591823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:57.592861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:57.845591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:57.846039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:57.846538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:57.907360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:57.907798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:57.908230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 14ms/step - loss: 0.1207 - val_loss: 0.1141 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0775
2023-11-26 16:39:58.571341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:58.571763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:58.572160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:39:58.633758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:39:58.634183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:39:58.634563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.1101 - val_loss: 0.1091 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1027 - val_loss: 0.1030 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0990 - val_loss: 0.0925 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0967 - val_loss: 0.0868 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0950 - val_loss: 0.0840 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0904 - val_loss: 0.0784 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0861 - val_loss: 0.0795 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0857 - val_loss: 0.0792 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0865 - val_loss: 0.0751 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0730 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0691 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0680 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.0673 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0635 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0683 - val_loss: 0.0614 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0597 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0661 - val_loss: 0.0560 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0548 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0631 - val_loss: 0.0533 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0510 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0498 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0490 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0481 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0496 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0478 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0480 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0480 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0478 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0479 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0542 - val_loss: 0.0476 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0541 - val_loss: 0.0473 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0533 - val_loss: 0.0475 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0547 - val_loss: 0.0473 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0547 - val_loss: 0.0473 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0541 - val_loss: 0.0473 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0474 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0526 - val_loss: 0.0475 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0475 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0540 - val_loss: 0.0475 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0475 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0540 - val_loss: 0.0475 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0530 - val_loss: 0.0475 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0475 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0475 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0475 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0475 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0475 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0475 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0475 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0540 - val_loss: 0.0475 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0540 - val_loss: 0.0475 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0530 - val_loss: 0.0475 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0540 - val_loss: 0.0475 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0533 - val_loss: 0.0475 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0553 - val_loss: 0.0475 - lr: 2.2603e-09
Epoch 1/100
2023-11-26 16:40:04.272423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:04.273004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:04.273463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:04.326628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:04.327050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:04.327425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:04.412587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:04.413062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:04.413475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:04.473853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:04.474617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:04.475514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:04.731667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:04.732127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:04.732809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:04.791912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:04.792388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:04.792803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 12ms/step - loss: 0.1279 - val_loss: 0.1117 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0777
2023-11-26 16:40:05.488917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:05.489433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:05.490069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:05.557201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:05.557673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:05.558052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.1093 - val_loss: 0.1041 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1014 - val_loss: 0.1159 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0987 - val_loss: 0.1150 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0916 - val_loss: 0.1135 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0884 - val_loss: 0.1111 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0831 - val_loss: 0.1091 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0824 - val_loss: 0.1047 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.1102 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0994 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.1093 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.1151 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0795 - val_loss: 0.1192 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0843 - val_loss: 0.1010 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0807 - val_loss: 0.1000 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0789 - val_loss: 0.0885 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0974 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0770 - val_loss: 0.0870 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0728 - val_loss: 0.0864 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0829 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0817 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0659 - val_loss: 0.0776 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.0748 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0631 - val_loss: 0.0738 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0724 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0714 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0713 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0706 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0698 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0697 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0697 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0696 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0695 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0693 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0693 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0693 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0693 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0693 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0692 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0692 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0691 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0691 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0691 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0691 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0691 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0691 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0691 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0691 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0691 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0691 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0691 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0691 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0691 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0597 - val_loss: 0.0691 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0691 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0691 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0691 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0691 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0691 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0691 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0691 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0691 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0691 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0691 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0691 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0691 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0691 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0691 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0691 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0597 - val_loss: 0.0691 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0691 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0691 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0691 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0691 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0691 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0691 - lr: 1.1370e-14
Epoch 1/100
2023-11-26 16:40:15.017901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:15.018286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:15.018649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:15.069666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:15.070046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:15.070388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:15.154027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:15.154523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:15.155011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:15.214596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:15.215078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:15.215490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:15.461846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:15.462684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:15.463488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:15.529468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:15.529998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:15.530444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 10ms/step - loss: 0.1319 - val_loss: 0.1084 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0737
2023-11-26 16:40:16.233932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:16.234375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:16.234769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:16.300906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:16.301443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:16.301934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.1095 - val_loss: 0.1055 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1006 - val_loss: 0.1003 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0916 - val_loss: 0.0955 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0866 - val_loss: 0.0946 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0839 - val_loss: 0.0894 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0807 - val_loss: 0.0876 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0825 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0786 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0784 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.0769 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0756 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0707 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0644 - val_loss: 0.0701 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0686 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0683 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0656 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0635 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0632 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0603 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0596 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0596 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0592 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0585 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0604 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0599 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0582 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0560 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0546 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0535 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0530 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0529 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0529 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0528 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0528 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0528 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0528 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0527 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0527 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0527 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0527 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0527 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0527 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0527 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0527 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0527 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0527 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0527 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0527 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0527 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0527 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0527 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0527 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0527 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0527 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0527 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0527 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0527 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0527 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0527 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0527 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0527 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0527 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0527 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0527 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0527 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0527 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0527 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0527 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0527 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0527 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0527 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0527 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0527 - lr: 4.6110e-14
Average Validation Loss: 0.06694167107343674
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:40:27.610607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:27.611195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:27.611665: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:27.665903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:27.666300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:27.666643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:27.748929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:27.749416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:27.749829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:27.810775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:27.811348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:27.811842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:28.059140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:28.059600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:28.060160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:28.117577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:28.118020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:28.118447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 2s 166ms/step - loss: 0.2519 - val_loss: 0.1911 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1212
2023-11-26 16:40:29.084859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:29.085338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:29.086014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:29.146635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:29.147042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:29.147417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 9ms/step - loss: 0.1538 - val_loss: 0.1383 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1158 - val_loss: 0.1362 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1057 - val_loss: 0.1429 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1126 - val_loss: 0.1486 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1160 - val_loss: 0.1513 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1135 - val_loss: 0.1504 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1124 - val_loss: 0.1469 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1126 - val_loss: 0.1431 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1077 - val_loss: 0.1377 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1046 - val_loss: 0.1344 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0996 - val_loss: 0.1349 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0976 - val_loss: 0.1353 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0952 - val_loss: 0.1342 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0951 - val_loss: 0.1330 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0906 - val_loss: 0.1327 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0886 - val_loss: 0.1320 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0888 - val_loss: 0.1309 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0846 - val_loss: 0.1313 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0854 - val_loss: 0.1327 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0794 - val_loss: 0.1307 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0779 - val_loss: 0.1308 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0799 - val_loss: 0.1315 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0791 - val_loss: 0.1306 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0771 - val_loss: 0.1306 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0763 - val_loss: 0.1311 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0786 - val_loss: 0.1313 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0726 - val_loss: 0.1312 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0800 - val_loss: 0.1318 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0753 - val_loss: 0.1324 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.1326 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0765 - val_loss: 0.1325 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0771 - val_loss: 0.1327 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0752 - val_loss: 0.1327 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0779 - val_loss: 0.1326 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.1326 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0744 - val_loss: 0.1326 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0752 - val_loss: 0.1326 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0754 - val_loss: 0.1326 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0765 - val_loss: 0.1326 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.1326 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0745 - val_loss: 0.1326 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0765 - val_loss: 0.1326 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0786 - val_loss: 0.1326 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0785 - val_loss: 0.1326 - lr: 3.3546e-07
Epoch 1/100
2023-11-26 16:40:30.847782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:30.848519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:30.848909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:30.906650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:30.907300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:30.907695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:31.002574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:31.003085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:31.003538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:31.074122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:31.075921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:31.076645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:31.324657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:31.325383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:31.325882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:31.386735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:31.387181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:31.387632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.1593 - val_loss: 0.1065 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0946
2023-11-26 16:40:31.998307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:31.999067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:31.999679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:32.063572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:32.064057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:32.064495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1246 - val_loss: 0.0745 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1212 - val_loss: 0.0725 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1139 - val_loss: 0.0755 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1100 - val_loss: 0.0739 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1052 - val_loss: 0.0739 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1030 - val_loss: 0.0749 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0985 - val_loss: 0.0732 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0942 - val_loss: 0.0749 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0914 - val_loss: 0.0801 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0879 - val_loss: 0.0763 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0847 - val_loss: 0.0846 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0812 - val_loss: 0.0763 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0794 - val_loss: 0.0771 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0770 - val_loss: 0.0773 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0738 - val_loss: 0.0804 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0770 - val_loss: 0.0759 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0745 - val_loss: 0.0781 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0736 - val_loss: 0.0767 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0723 - val_loss: 0.0731 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0693 - val_loss: 0.0730 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0704 - val_loss: 0.0779 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0693 - val_loss: 0.0763 - lr: 2.0190e-04
Epoch 1/100
2023-11-26 16:40:33.358732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:33.359340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:33.359720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:33.415376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:33.415763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:33.416152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:33.513618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:33.514116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:33.514746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:33.577621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:33.578142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:33.578819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:33.821800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:33.822263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:33.822883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:33.881502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:33.881917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:33.882329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 26ms/step - loss: 0.1332 - val_loss: 0.1287 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1092
2023-11-26 16:40:34.494196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:34.494704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:34.495410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:34.559278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:34.559840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:34.560361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1150 - val_loss: 0.1191 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1092 - val_loss: 0.1169 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1031 - val_loss: 0.1071 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1012 - val_loss: 0.0999 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0962 - val_loss: 0.0938 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0954 - val_loss: 0.0888 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0933 - val_loss: 0.0830 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0779 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0760 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0732 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0706 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.0696 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.0681 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.0668 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.0658 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0755 - val_loss: 0.0647 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.0649 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0726 - val_loss: 0.0633 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0630 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0620 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0612 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0610 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0603 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0604 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0608 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0604 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0675 - val_loss: 0.0603 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0600 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0601 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0602 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0676 - val_loss: 0.0602 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0684 - val_loss: 0.0602 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0601 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.0601 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0668 - val_loss: 0.0601 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0690 - val_loss: 0.0601 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0670 - val_loss: 0.0601 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0601 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0675 - val_loss: 0.0601 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0601 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0683 - val_loss: 0.0601 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0601 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.0601 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0677 - val_loss: 0.0601 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0664 - val_loss: 0.0601 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0682 - val_loss: 0.0601 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0667 - val_loss: 0.0601 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0674 - val_loss: 0.0601 - lr: 6.7729e-08
Epoch 1/100
2023-11-26 16:40:38.049839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:38.050309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:38.050687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:38.102470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:38.102842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:38.103179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:38.189116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:38.189601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:38.190102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:38.251395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:38.252122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:38.252692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:38.502367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:38.502844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:38.503312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:38.561715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:38.562183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:38.562607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 20ms/step - loss: 0.1379 - val_loss: 0.1066 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1137
2023-11-26 16:40:39.188809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:39.189306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:39.189968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:39.254201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:39.254650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:39.255068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1146 - val_loss: 0.1075 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1090 - val_loss: 0.1020 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1006 - val_loss: 0.0982 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0966 - val_loss: 0.1107 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0966 - val_loss: 0.0939 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.1022 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0976 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0865 - val_loss: 0.0983 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.0864 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0794 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0847 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.0825 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0702 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0627 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0642 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0642 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0579 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0648 - val_loss: 0.0588 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0654 - val_loss: 0.0582 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0564 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0573 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0646 - val_loss: 0.0558 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0557 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0556 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0622 - val_loss: 0.0550 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0553 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0551 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0542 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0541 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0543 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0544 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0543 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0543 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0543 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0542 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0542 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0541 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0541 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0541 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0541 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0541 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0541 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0541 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0624 - val_loss: 0.0541 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0541 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0541 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0541 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0541 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0541 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0541 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0615 - val_loss: 0.0541 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0608 - val_loss: 0.0541 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0541 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0541 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0541 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0615 - val_loss: 0.0541 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0615 - val_loss: 0.0541 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0541 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0541 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0541 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0541 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0541 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0541 - lr: 2.7751e-11
Epoch 1/100
2023-11-26 16:40:44.733077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:44.733556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:44.734034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:44.786463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:44.786826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:44.787171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:44.868915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:44.869396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:44.869783: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:44.934160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:44.934710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:44.935271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:45.181311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:45.182017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:45.182523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:45.241468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:45.241953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:45.242366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 16ms/step - loss: 0.1340 - val_loss: 0.1109 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1384
2023-11-26 16:40:45.910406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:45.910959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:45.911606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:45.973021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:45.973461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:45.973855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 5ms/step - loss: 0.1204 - val_loss: 0.1072 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1099 - val_loss: 0.1056 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1031 - val_loss: 0.1032 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1006 - val_loss: 0.1039 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.1015 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0951 - val_loss: 0.0991 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0994 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0955 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0875 - val_loss: 0.0966 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0865 - val_loss: 0.0958 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.0921 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0790 - val_loss: 0.0897 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0861 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0862 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0847 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0826 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0806 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0660 - val_loss: 0.0760 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0743 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0706 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0679 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0660 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0650 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0644 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0634 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0630 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0627 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0624 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0624 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0623 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0622 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0621 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0620 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0620 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0620 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0619 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0619 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0619 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0619 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0619 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0619 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0619 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0619 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0619 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0619 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0619 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0619 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0619 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0619 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0619 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0619 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0619 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0619 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0619 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0619 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0619 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0619 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0619 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0619 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0619 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0619 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0619 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0619 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0619 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0619 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0619 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0619 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0619 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0619 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0619 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0619 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0619 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0619 - lr: 4.6110e-14
Average Validation Loss: 0.07581303343176841
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:40:53.724561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:53.724996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:53.725626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:53.778996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:53.779426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:53.779778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:53.861816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:53.862391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:53.862840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:53.925970: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:53.926584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:53.927141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:54.175851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:54.176329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:54.176958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:54.238135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:54.238593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:54.239029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 20ms/step - loss: 0.1238 - val_loss: 0.1364 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0881
2023-11-26 16:40:54.866725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:54.867557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:54.867999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:54.934613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:54.935215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:54.935685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 4ms/step - loss: 0.1104 - val_loss: 0.1276 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1103 - val_loss: 0.1203 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0997 - val_loss: 0.1233 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0988 - val_loss: 0.1239 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1015 - val_loss: 0.1200 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0945 - val_loss: 0.1199 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0972 - val_loss: 0.1202 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0933 - val_loss: 0.1214 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0887 - val_loss: 0.1200 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0925 - val_loss: 0.1149 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0852 - val_loss: 0.1140 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0818 - val_loss: 0.1157 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0802 - val_loss: 0.1122 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.1124 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.1091 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0655 - val_loss: 0.1082 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0648 - val_loss: 0.1045 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.1013 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0975 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0931 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0961 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0899 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0923 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0885 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0933 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0903 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0890 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.0912 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0899 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0880 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.0892 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0903 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0903 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0906 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0904 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0905 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0903 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0903 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0902 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0902 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0902 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0902 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0902 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0901 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0450 - val_loss: 0.0901 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0901 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0901 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0901 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0467 - val_loss: 0.0901 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0901 - lr: 2.7536e-08
Epoch 1/100
2023-11-26 16:40:58.565128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:58.565721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:58.566079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:58.616794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:58.617172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:58.617506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:58.697111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:58.697630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:58.698116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:58.756786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:58.757275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:58.757693: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:58.938561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:58.939258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:58.939682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:58.997603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:58.998063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:58.998513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1343 - val_loss: 0.0720 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0646
2023-11-26 16:40:59.880480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:59.880914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:59.881616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:40:59.943603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:40:59.944062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:40:59.944457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1206 - val_loss: 0.0664 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1178 - val_loss: 0.0720 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1127 - val_loss: 0.0624 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1074 - val_loss: 0.0724 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1035 - val_loss: 0.0590 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1032 - val_loss: 0.0658 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0992 - val_loss: 0.0621 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0942 - val_loss: 0.0769 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0938 - val_loss: 0.0670 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0867 - val_loss: 0.0811 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0791 - val_loss: 0.0815 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0807 - val_loss: 0.0720 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0791 - val_loss: 0.0704 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0681 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0642 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0639 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0646 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0579 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0599 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0584 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0593 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0673 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0670 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0622 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0663 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0643 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0666 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0646 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0666 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0666 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0666 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0671 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0667 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0668 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0666 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0667 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0668 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0669 - lr: 3.3460e-06
Epoch 1/100
2023-11-26 16:41:03.448831: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:03.449206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:03.449602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:03.500529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:03.500923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:03.501275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:03.586100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:03.586582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:03.587023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:03.647521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:03.648000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:03.648422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:03.884569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:03.885286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:03.885779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:03.944001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:03.944472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:03.944893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 8ms/step - loss: 0.1153 - val_loss: 0.1067 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0851
2023-11-26 16:41:04.647426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:04.648049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:04.648570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:04.712514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:04.712988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:04.713423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.1037 - val_loss: 0.1003 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1031 - val_loss: 0.0982 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0999 - val_loss: 0.0911 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0959 - val_loss: 0.0862 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0948 - val_loss: 0.0841 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0927 - val_loss: 0.0854 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0914 - val_loss: 0.0846 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0879 - val_loss: 0.0808 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.0789 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0819 - val_loss: 0.0729 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0660 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0650 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0662 - val_loss: 0.0599 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0564 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0520 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0520 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0510 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0523 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0483 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0499 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0494 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0474 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0448 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0450 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0462 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0466 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0465 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0469 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0469 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0469 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0468 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0468 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0466 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0466 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0467 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0468 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0468 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0469 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0468 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0468 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0469 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0469 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0469 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:41:11.681196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:11.681584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:11.682037: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:11.732418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:11.732905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:11.733250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:11.815735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:11.816294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:11.816751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:11.876357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:11.876751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:11.877185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:12.116940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:12.117423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:12.117873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:12.178366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:12.178845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:12.179272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1166 - val_loss: 0.1216 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1314
2023-11-26 16:41:12.953669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:12.954109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:12.954738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:13.018290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:13.018781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:13.019204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 3ms/step - loss: 0.1029 - val_loss: 0.1185 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0971 - val_loss: 0.1132 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0910 - val_loss: 0.0935 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0870 - val_loss: 0.0852 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0984 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0735 - val_loss: 0.0956 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0727 - val_loss: 0.0784 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0697 - val_loss: 0.0849 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0682 - val_loss: 0.0760 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0694 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0690 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0688 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0680 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0665 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0671 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0657 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0632 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0661 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0643 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0643 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0645 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0599 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0603 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0550 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0509 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0486 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0471 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0460 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0457 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0453 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0449 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0448 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0447 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0445 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0446 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0445 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0445 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0444 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0444 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0445 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0444 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0444 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0444 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0444 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0444 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0444 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0444 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0444 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0444 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0444 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0444 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0444 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0444 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0444 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0444 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0444 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0444 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0444 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0444 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0444 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0444 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0444 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0444 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0444 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0444 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0444 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0444 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0444 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0444 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0444 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0444 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0444 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0444 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0444 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0444 - lr: 5.6464e-15
Epoch 1/100
2023-11-26 16:41:28.494589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:28.495074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:28.495496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:28.546235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:28.546573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:28.546920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:28.633162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:28.633692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:28.634295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:28.697702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:28.698367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:28.698831: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:28.940741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:28.941283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:28.941698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:28.999343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:28.999813: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:29.000233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 6ms/step - loss: 0.1153 - val_loss: 0.1013 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0723
2023-11-26 16:41:29.799669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:29.800152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:29.800659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:29.862362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:29.862855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:29.863265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1019 - val_loss: 0.1002 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0967 - val_loss: 0.0987 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.0967 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0874 - val_loss: 0.0943 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.0924 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0839 - val_loss: 0.0904 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0802 - val_loss: 0.0889 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0790 - val_loss: 0.0871 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0858 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0826 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0802 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0793 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0792 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0793 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0775 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0753 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0726 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0734 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0698 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0686 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0678 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0670 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0665 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0450 - val_loss: 0.0661 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0650 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0641 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0639 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0429 - val_loss: 0.0638 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0428 - val_loss: 0.0629 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0425 - val_loss: 0.0625 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0429 - val_loss: 0.0614 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0421 - val_loss: 0.0609 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0427 - val_loss: 0.0606 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0604 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0602 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0427 - val_loss: 0.0601 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0600 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0599 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0599 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0598 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0598 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0598 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0425 - val_loss: 0.0598 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0598 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0598 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0598 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0598 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0598 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0598 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0428 - val_loss: 0.0598 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0408 - val_loss: 0.0598 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0598 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0432 - val_loss: 0.0598 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0598 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0598 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0598 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0598 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0417 - val_loss: 0.0598 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0598 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0429 - val_loss: 0.0598 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0598 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0598 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0421 - val_loss: 0.0598 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0598 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0598 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0598 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0598 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0598 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0598 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0598 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0429 - val_loss: 0.0598 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0598 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0598 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0598 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0598 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0598 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0598 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0598 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0598 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0598 - lr: 3.1068e-16
Average Validation Loss: 0.05898429974913597
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 16:41:49.717216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:49.717728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:49.718037: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:49.772577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:49.773043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:49.773509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:49.855116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:49.855590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:49.856002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:49.917547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:49.917966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:49.918381: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:50.165280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:50.166083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:50.166526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:50.224963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:50.225417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:50.225836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.2572 - val_loss: 0.1904 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1727
2023-11-26 16:41:50.827951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:50.828605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:50.829019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:50.893087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:50.893575: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:50.893981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 5ms/step - loss: 0.1476 - val_loss: 0.1332 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1139 - val_loss: 0.1292 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1118 - val_loss: 0.1309 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1102 - val_loss: 0.1267 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1058 - val_loss: 0.1176 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0989 - val_loss: 0.1091 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.1034 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.1034 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0723 - val_loss: 0.1035 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.1005 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0988 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0992 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0949 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0996 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0940 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0989 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0501 - val_loss: 0.0925 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0967 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0934 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0472 - val_loss: 0.0952 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0949 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0924 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0943 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0947 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0947 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0935 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0930 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.0931 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0929 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0929 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0931 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0935 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0450 - val_loss: 0.0936 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0936 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0936 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0937 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0444 - val_loss: 0.0937 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.0936 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0936 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0935 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0935 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0935 - lr: 7.4659e-07
Epoch 1/100
2023-11-26 16:41:52.994423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:52.994945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:52.995276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:53.052402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:53.052818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:53.053268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:53.136506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:53.136969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:53.137397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:53.206508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:53.207075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:53.207690: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:53.401684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:53.402125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:53.402817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:53.466368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:53.467180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:53.467692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.1505 - val_loss: 0.0783 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0579
2023-11-26 16:41:53.965908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:53.966686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:53.967128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:54.030824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:54.031285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:54.031673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 3ms/step - loss: 0.1180 - val_loss: 0.0755 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1108 - val_loss: 0.0763 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1053 - val_loss: 0.0657 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1019 - val_loss: 0.0615 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0955 - val_loss: 0.0592 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0943 - val_loss: 0.0574 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0893 - val_loss: 0.0609 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0859 - val_loss: 0.0631 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0810 - val_loss: 0.0621 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0809 - val_loss: 0.0653 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0745 - val_loss: 0.0612 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0704 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0643 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0686 - val_loss: 0.0634 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0571 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0681 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0612 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0628 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0642 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0589 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0611 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0626 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0602 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0623 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0602 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0613 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0610 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0616 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0612 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0539 - val_loss: 0.0601 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0602 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0601 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0599 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0599 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0600 - lr: 8.2297e-06
Epoch 1/100
2023-11-26 16:41:56.179709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:56.180140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:56.180584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:56.232809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:56.233203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:56.233557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:56.313695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:56.314174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:56.314728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:56.376300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:56.376754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:56.377162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:56.613523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:56.613994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:56.614556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:56.673272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:56.673729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:56.674175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 2s 14ms/step - loss: 0.1161 - val_loss: 0.1124 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0595
2023-11-26 16:41:57.780201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:57.780806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:57.781307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:41:57.846079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:41:57.846581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:41:57.846998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.0994 - val_loss: 0.1045 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0920 - val_loss: 0.0940 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0896 - val_loss: 0.0880 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0869 - val_loss: 0.0836 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0829 - val_loss: 0.0802 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0813 - val_loss: 0.0772 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0800 - val_loss: 0.0737 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0690 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.0650 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.0623 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0552 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.0540 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0498 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0481 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0489 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0471 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0499 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0572 - val_loss: 0.0509 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0479 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0459 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0529 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0553 - val_loss: 0.0525 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0524 - val_loss: 0.0515 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0517 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0498 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0508 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0482 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0504 - val_loss: 0.0492 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0495 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0505 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0500 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0497 - val_loss: 0.0498 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0496 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0496 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0498 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0495 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0494 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0494 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0494 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0494 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:42:01.970558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:01.970986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:01.971578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:02.022062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:02.022429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:02.022770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:02.106188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:02.106673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:02.107095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:02.166586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:02.167035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:02.167445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:02.407342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:02.407898: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:02.408314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:02.466669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:02.467116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:02.467554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.1444 - val_loss: 0.1043 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0707
2023-11-26 16:42:03.145279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:03.145790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:03.146434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:03.210474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:03.210919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:03.211311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 4ms/step - loss: 0.1147 - val_loss: 0.0974 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1003 - val_loss: 0.1025 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0964 - val_loss: 0.1044 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0960 - val_loss: 0.1061 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0918 - val_loss: 0.1010 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0863 - val_loss: 0.0968 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0824 - val_loss: 0.0827 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0750 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0674 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0652 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0575 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0555 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0565 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0548 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0547 - val_loss: 0.0574 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0622 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0589 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0585 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0526 - val_loss: 0.0654 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0562 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0655 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0539 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0394 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0549 - val_loss: 0.0362 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0528 - val_loss: 0.0360 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0362 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0362 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0361 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0364 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0365 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0362 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0362 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0362 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0362 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0362 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0362 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0362 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0362 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0362 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0362 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0362 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0362 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0362 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0362 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0362 - lr: 2.2487e-07
Epoch 1/100
2023-11-26 16:42:08.907687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:08.908065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:08.908414: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:08.960675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:08.960999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:08.961358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:09.044472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:09.044960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:09.045371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:09.105438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:09.105921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:09.106332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:09.356687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:09.357127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:09.357610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:09.423221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:09.423736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:09.424140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 10ms/step - loss: 0.1228 - val_loss: 0.1014 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0606
2023-11-26 16:42:10.146602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:10.147027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:10.147795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:10.210179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:10.210633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:10.211012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 4ms/step - loss: 0.1032 - val_loss: 0.1012 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0991 - val_loss: 0.0993 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0965 - val_loss: 0.0980 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.0960 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0880 - val_loss: 0.0963 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0852 - val_loss: 0.0935 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0829 - val_loss: 0.0924 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0797 - val_loss: 0.0917 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0780 - val_loss: 0.0901 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0897 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0751 - val_loss: 0.0896 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0742 - val_loss: 0.0884 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0884 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0706 - val_loss: 0.0876 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0719 - val_loss: 0.0897 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0735 - val_loss: 0.0913 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0734 - val_loss: 0.0905 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0734 - val_loss: 0.0907 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0714 - val_loss: 0.0874 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0862 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0851 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0830 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0631 - val_loss: 0.0817 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0801 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0792 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0781 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0775 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0773 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0769 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0765 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0762 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0760 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0760 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0759 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0758 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0758 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0758 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0553 - val_loss: 0.0757 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0555 - val_loss: 0.0757 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0757 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0757 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0757 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0757 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0757 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0757 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0757 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0555 - val_loss: 0.0757 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0757 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0757 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0757 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0757 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0757 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0757 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0757 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0757 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0757 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0757 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0757 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0757 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0550 - val_loss: 0.0757 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0757 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0757 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0757 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0757 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0757 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0757 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0757 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0757 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0757 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0757 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0757 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0757 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0757 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0757 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0757 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0757 - lr: 5.6464e-15
Average Validation Loss: 0.061415930092334745
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 16:42:21.719566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:21.720001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:21.720521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:21.772984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:21.773357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:21.773717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:21.855150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:21.855627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:21.856041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:21.916260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:21.916771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:21.917205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:22.151399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:22.151864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:22.152303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:22.210113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:22.210602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:22.211015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 65ms/step - loss: 0.1504 - val_loss: 0.1290 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0743
2023-11-26 16:42:22.765415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:22.765918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:22.766571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:22.828564: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:22.828993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:22.829362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 9ms/step - loss: 0.1045 - val_loss: 0.1237 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1034 - val_loss: 0.1270 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1052 - val_loss: 0.1285 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1062 - val_loss: 0.1270 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1009 - val_loss: 0.1239 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1001 - val_loss: 0.1191 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0981 - val_loss: 0.1149 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0934 - val_loss: 0.1128 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0918 - val_loss: 0.1126 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0876 - val_loss: 0.1117 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0810 - val_loss: 0.1088 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0796 - val_loss: 0.1056 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0754 - val_loss: 0.1049 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0718 - val_loss: 0.1047 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0698 - val_loss: 0.1009 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0625 - val_loss: 0.0994 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0628 - val_loss: 0.1022 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0626 - val_loss: 0.1022 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0589 - val_loss: 0.0983 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0614 - val_loss: 0.0969 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0566 - val_loss: 0.0973 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0592 - val_loss: 0.0990 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0590 - val_loss: 0.1002 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0571 - val_loss: 0.0996 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0602 - val_loss: 0.0991 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0559 - val_loss: 0.0985 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0569 - val_loss: 0.0971 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0581 - val_loss: 0.0963 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0585 - val_loss: 0.0967 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0558 - val_loss: 0.0970 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0586 - val_loss: 0.0969 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0583 - val_loss: 0.0971 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0559 - val_loss: 0.0971 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0572 - val_loss: 0.0970 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0585 - val_loss: 0.0969 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0583 - val_loss: 0.0968 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0564 - val_loss: 0.0969 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0567 - val_loss: 0.0969 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0578 - val_loss: 0.0969 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0555 - val_loss: 0.0969 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0562 - val_loss: 0.0969 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0567 - val_loss: 0.0969 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0557 - val_loss: 0.0969 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0573 - val_loss: 0.0969 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0548 - val_loss: 0.0970 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0562 - val_loss: 0.0970 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0566 - val_loss: 0.0970 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0575 - val_loss: 0.0970 - lr: 6.7729e-08
Epoch 1/100
2023-11-26 16:42:24.625572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:24.625985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:24.626533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:24.679871: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:24.680263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:24.680624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:24.760975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:24.761448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:24.761857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:24.821847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:24.822358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:24.822720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:25.058032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:25.058516: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:25.059094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:25.117093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:25.117543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:25.117955: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1479 - val_loss: 0.0827 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0829
2023-11-26 16:42:25.697854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:25.698305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:25.698840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:25.759675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:25.760147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:25.760542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1130 - val_loss: 0.0693 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1105 - val_loss: 0.0702 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1034 - val_loss: 0.0736 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0995 - val_loss: 0.0681 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0940 - val_loss: 0.0818 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0892 - val_loss: 0.0763 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0862 - val_loss: 0.0806 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0814 - val_loss: 0.0789 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0759 - val_loss: 0.0869 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0761 - val_loss: 0.0773 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0728 - val_loss: 0.0834 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0722 - val_loss: 0.0703 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0674 - val_loss: 0.0828 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0681 - val_loss: 0.0752 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0679 - val_loss: 0.0821 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0652 - val_loss: 0.0727 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0644 - val_loss: 0.0794 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0656 - val_loss: 0.0707 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0652 - val_loss: 0.0763 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0649 - val_loss: 0.0700 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0648 - val_loss: 0.0740 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0639 - val_loss: 0.0729 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0623 - val_loss: 0.0693 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0614 - val_loss: 0.0706 - lr: 1.3534e-04
Epoch 1/100
2023-11-26 16:42:27.125404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:27.125835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:27.126499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:27.177518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:27.177937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:27.178310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:27.263018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:27.263513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:27.263939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:27.328933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:27.329469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:27.329922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:27.580561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:27.581062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:27.581658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:27.640000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:27.640452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:27.640881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 27ms/step - loss: 0.1230 - val_loss: 0.1139 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.0991
2023-11-26 16:42:28.253479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:28.254065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:28.254722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:28.320568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:28.321030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:28.321428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 5ms/step - loss: 0.1063 - val_loss: 0.1067 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.1062 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0930 - val_loss: 0.0934 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0890 - val_loss: 0.0861 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0765 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0712 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.0670 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.0650 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.0583 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.0562 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.0594 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0583 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0556 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0556 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0565 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0540 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0543 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.0527 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0544 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0520 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0649 - val_loss: 0.0533 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.0517 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0640 - val_loss: 0.0522 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0643 - val_loss: 0.0537 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0640 - val_loss: 0.0521 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0631 - val_loss: 0.0510 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0635 - val_loss: 0.0511 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0516 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0520 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0517 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0515 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0518 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0518 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0517 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0517 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0516 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0516 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0516 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0516 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0516 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0516 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0516 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0516 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0516 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0608 - val_loss: 0.0516 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0516 - lr: 1.5073e-07
Epoch 1/100
2023-11-26 16:42:31.564208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:31.564869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:31.565223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:31.616311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:31.616692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:31.617043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:31.701688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:31.702179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:31.702595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:31.762922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:31.763411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:31.763820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:32.443555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:32.444229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:32.444651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:32.502571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:32.503044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:32.503475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 2s 20ms/step - loss: 0.1580 - val_loss: 0.1002 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1193
2023-11-26 16:42:33.123042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:33.123518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:33.124260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:33.186592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:33.187029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:33.187416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1103 - val_loss: 0.1015 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1012 - val_loss: 0.0969 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0935 - val_loss: 0.0919 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.1044 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0950 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.0929 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0946 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0925 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0885 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0889 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0842 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0724 - val_loss: 0.0838 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0812 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0814 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.0798 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0673 - val_loss: 0.0789 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.0762 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0660 - val_loss: 0.0744 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0637 - val_loss: 0.0733 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0744 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0710 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0713 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0709 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0700 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0697 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0689 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0686 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0696 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0684 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0676 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0680 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0681 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0679 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0679 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0680 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0679 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0679 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0679 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0679 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0679 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0679 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0679 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0679 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0679 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0679 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0679 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0679 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0679 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0679 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0679 - lr: 2.7536e-08
Epoch 1/100
2023-11-26 16:42:37.548721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:37.549157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:37.549662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:37.600063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:37.600372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:37.600718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:37.684065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:37.684542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:37.684892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:37.744067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:37.744551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:37.744978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:37.981390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:37.981854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:37.982281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:38.040095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:38.040566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:38.041015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 16ms/step - loss: 0.1193 - val_loss: 0.1008 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1233
2023-11-26 16:42:38.672096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:38.672579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:38.673223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:38.734428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:38.734896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:38.735296: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 5ms/step - loss: 0.1047 - val_loss: 0.0958 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0886 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0865 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0824 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.0831 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.0827 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.0841 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0831 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0772 - val_loss: 0.0860 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0857 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0867 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0840 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0790 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0647 - val_loss: 0.0751 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0715 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0716 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0717 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0702 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0651 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0602 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0584 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0575 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0554 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0548 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0546 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0537 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0535 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0531 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0534 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0530 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0528 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0530 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0529 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0527 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0528 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0527 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0528 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0528 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0528 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0528 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0528 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0528 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0528 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0528 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0528 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0528 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0528 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0528 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0528 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0528 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0528 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0528 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0528 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0528 - lr: 2.2603e-09
Average Validation Loss: 0.06714925467967987
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:42:44.509191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:44.509635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:44.510234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:44.567885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:44.568202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:44.568559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:44.650389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:44.650845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:44.651265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:44.710770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:44.711468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:44.712017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:44.949325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:44.949863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:44.950300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:45.008203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:45.008669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:45.009102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 20ms/step - loss: 0.2454 - val_loss: 0.2331 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1787
2023-11-26 16:42:45.622788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:45.623226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:45.623616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:45.689772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:45.690242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:45.690669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.2195 - val_loss: 0.2281 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.2122 - val_loss: 0.2115 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1953 - val_loss: 0.2063 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1869 - val_loss: 0.1967 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1730 - val_loss: 0.1881 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1632 - val_loss: 0.1829 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1421 - val_loss: 0.2190 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1677 - val_loss: 0.1631 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1322 - val_loss: 0.1576 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1123 - val_loss: 0.1889 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1163 - val_loss: 0.1987 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1324 - val_loss: 0.1481 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1125 - val_loss: 0.1408 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1052 - val_loss: 0.1382 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.1381 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0940 - val_loss: 0.1329 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0900 - val_loss: 0.1621 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0958 - val_loss: 0.1304 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0875 - val_loss: 0.1413 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0884 - val_loss: 0.1452 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0894 - val_loss: 0.1318 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0835 - val_loss: 0.1381 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.1309 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.1370 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0852 - val_loss: 0.1339 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0832 - val_loss: 0.1308 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.1312 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1368 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.1311 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.1336 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.1343 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.1319 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.1322 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1323 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0812 - val_loss: 0.1327 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0807 - val_loss: 0.1326 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0807 - val_loss: 0.1325 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.1322 - lr: 3.3460e-06
Epoch 1/100
2023-11-26 16:42:48.953858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:48.954269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:48.954731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:49.011059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:49.011424: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:49.011776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:49.092595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:49.093014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:49.093432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:49.153472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:49.153939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:49.154369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:49.336749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:49.337240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:49.337769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:49.395420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:49.395887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:49.396307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.2530 - val_loss: 0.1905 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1623
2023-11-26 16:42:49.907908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:49.908336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:49.908782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:49.972234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:49.972681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:49.973070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.2239 - val_loss: 0.1684 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.2051 - val_loss: 0.1541 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1874 - val_loss: 0.1445 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1809 - val_loss: 0.1236 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1662 - val_loss: 0.1386 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1616 - val_loss: 0.1113 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1520 - val_loss: 0.1307 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1458 - val_loss: 0.1039 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1410 - val_loss: 0.1234 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1345 - val_loss: 0.0976 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1287 - val_loss: 0.1168 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1171 - val_loss: 0.1109 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1156 - val_loss: 0.1082 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1065 - val_loss: 0.1066 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1024 - val_loss: 0.1016 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0983 - val_loss: 0.0901 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0951 - val_loss: 0.0912 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0897 - val_loss: 0.0881 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0865 - val_loss: 0.0847 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0840 - val_loss: 0.0850 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0818 - val_loss: 0.0835 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0779 - val_loss: 0.0844 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0864 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0861 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0742 - val_loss: 0.0876 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0879 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0872 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0888 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0704 - val_loss: 0.0876 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0879 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0701 - val_loss: 0.0884 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0890 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0701 - val_loss: 0.0889 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0890 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0888 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0888 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0888 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0889 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0890 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0890 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0697 - val_loss: 0.0890 - lr: 1.1138e-06
Epoch 1/100
2023-11-26 16:42:54.607087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:54.607493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:54.608095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:54.665031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:54.665442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:54.665827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:54.748744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:54.749222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:54.749646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:54.810756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:54.811271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:54.811702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:55.060263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:55.060728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:55.061278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:55.120440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:55.120841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:55.121249: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.2260 - val_loss: 0.2046 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1975
2023-11-26 16:42:55.860476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:55.860933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:55.861486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:42:55.922709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:42:55.923170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:42:55.923569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1903 - val_loss: 0.1730 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1671 - val_loss: 0.1526 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1499 - val_loss: 0.1379 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1401 - val_loss: 0.1274 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1343 - val_loss: 0.1224 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1290 - val_loss: 0.1180 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1203 - val_loss: 0.1133 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1162 - val_loss: 0.1085 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1102 - val_loss: 0.1078 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1067 - val_loss: 0.1030 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1015 - val_loss: 0.0896 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0966 - val_loss: 0.0914 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0890 - val_loss: 0.0786 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0875 - val_loss: 0.0800 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0794 - val_loss: 0.0730 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0744 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.0685 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.0700 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0690 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.0667 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0663 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0635 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0655 - val_loss: 0.0615 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0644 - val_loss: 0.0600 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0638 - val_loss: 0.0595 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0593 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0591 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0594 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0597 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0598 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0597 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0600 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0601 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0601 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0603 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0602 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0601 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0601 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0601 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0572 - val_loss: 0.0602 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0602 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0602 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0602 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0602 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0602 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0602 - lr: 1.0104e-07
Epoch 1/100
2023-11-26 16:43:04.954021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:04.954494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:04.954846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:05.010070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:05.010549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:05.010949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:05.098434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:05.098997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:05.099491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:05.161166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:05.161687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:05.162342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:05.400303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:05.400771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:05.401304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:05.459827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:05.460235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:05.460650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 8ms/step - loss: 0.2266 - val_loss: 0.2093 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.2217
2023-11-26 16:43:06.244593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:06.245090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:06.245504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:06.310492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:06.310895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:06.311254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1872 - val_loss: 0.1727 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1618 - val_loss: 0.1513 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1458 - val_loss: 0.1416 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1317 - val_loss: 0.1278 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1203 - val_loss: 0.1198 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1133 - val_loss: 0.1127 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1068 - val_loss: 0.1143 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1009 - val_loss: 0.1143 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0967 - val_loss: 0.1059 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0904 - val_loss: 0.1099 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0866 - val_loss: 0.0978 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0799 - val_loss: 0.0985 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0767 - val_loss: 0.0947 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0768 - val_loss: 0.0853 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.0818 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0791 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0754 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0754 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0663 - val_loss: 0.0734 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0717 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0632 - val_loss: 0.0736 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0710 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0715 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0604 - val_loss: 0.0727 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0707 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0700 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0674 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0630 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0610 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0598 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0594 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0574 - val_loss: 0.0591 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0589 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0588 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0587 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0587 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0586 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0586 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0586 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0586 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0586 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0586 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0586 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0586 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0586 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0586 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0586 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0586 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0586 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0586 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0586 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0586 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0586 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0586 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0586 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0586 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0586 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0586 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0586 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0586 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0586 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0586 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0586 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0586 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0586 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0586 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0586 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0586 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0586 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0586 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0586 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0586 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0586 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0586 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0586 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0586 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0586 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0586 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0586 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0586 - lr: 3.1068e-16
Epoch 82/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0586 - lr: 1.3960e-16
Epoch 83/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0586 - lr: 6.2726e-17
Epoch 84/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0586 - lr: 2.8185e-17
Epoch 1/100
2023-11-26 16:43:26.746127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:26.746546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:26.747180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:26.801454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:26.801878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:26.802234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:26.888820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:26.889245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:26.889680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:26.952812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:26.953330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:26.953889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:27.625469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:27.626112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:27.626754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:27.686388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:27.686855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:27.687271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 2s 7ms/step - loss: 0.2213 - val_loss: 0.1840 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1269
2023-11-26 16:43:28.549784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:28.550459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:28.551101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:28.613876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:28.614338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:28.614725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 4ms/step - loss: 0.1746 - val_loss: 0.1519 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1501 - val_loss: 0.1373 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1355 - val_loss: 0.1264 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1261 - val_loss: 0.1189 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1155 - val_loss: 0.1138 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1085 - val_loss: 0.1103 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1048 - val_loss: 0.1059 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0989 - val_loss: 0.1024 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0935 - val_loss: 0.0975 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0826 - val_loss: 0.0930 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0777 - val_loss: 0.0887 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0730 - val_loss: 0.0858 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0835 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0825 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0804 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0805 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0779 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0773 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0769 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0546 - val_loss: 0.0745 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0729 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0702 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0690 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0680 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0667 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0665 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0657 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0654 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0650 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0648 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.0648 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0648 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0649 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0649 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0648 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0649 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0649 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.0649 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.0649 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0650 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0650 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0650 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0467 - val_loss: 0.0650 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0650 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0650 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0650 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0650 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0650 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0650 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0650 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0650 - lr: 1.6702e-08
Average Validation Loss: 0.07925677299499512
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
2023-11-26 16:43:44.085555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:44.086250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:44.086704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:44.141606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:44.142029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:44.142367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:44.225835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:44.226328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:44.226744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:44.287114: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:44.287673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:44.288209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:44.534023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:44.534475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:44.534911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:44.599772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:44.600208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:44.600560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.2312 - val_loss: 0.2758 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2222
2023-11-26 16:43:45.187840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:45.188351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:45.189006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:45.249896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:45.250359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:45.250759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 7ms/step - loss: 0.2381 - val_loss: 0.2597 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2288 - val_loss: 0.2293 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2083 - val_loss: 0.2224 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1960 - val_loss: 0.2218 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1904 - val_loss: 0.2188 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1832 - val_loss: 0.2095 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1718 - val_loss: 0.2051 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1643 - val_loss: 0.1964 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1488 - val_loss: 0.1906 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1397 - val_loss: 0.1763 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1339 - val_loss: 0.1721 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1200 - val_loss: 0.1793 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1183 - val_loss: 0.1683 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1135 - val_loss: 0.1655 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1102 - val_loss: 0.1704 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1085 - val_loss: 0.1610 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1057 - val_loss: 0.1648 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1043 - val_loss: 0.1603 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1027 - val_loss: 0.1610 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1012 - val_loss: 0.1580 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1006 - val_loss: 0.1602 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1005 - val_loss: 0.1539 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0995 - val_loss: 0.1579 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0990 - val_loss: 0.1556 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0985 - val_loss: 0.1548 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0979 - val_loss: 0.1554 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0984 - val_loss: 0.1552 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0969 - val_loss: 0.1562 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0983 - val_loss: 0.1556 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0985 - val_loss: 0.1545 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0972 - val_loss: 0.1543 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0969 - val_loss: 0.1541 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0975 - val_loss: 0.1542 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0979 - val_loss: 0.1543 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0973 - val_loss: 0.1543 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0978 - val_loss: 0.1543 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0971 - val_loss: 0.1543 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0970 - val_loss: 0.1543 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0975 - val_loss: 0.1542 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0977 - val_loss: 0.1542 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0969 - val_loss: 0.1543 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0987 - val_loss: 0.1543 - lr: 7.4659e-07
Epoch 1/100
2023-11-26 16:43:47.815206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:47.815629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:47.816071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:47.876557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:47.876981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:47.877324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:47.958006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:47.958495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:47.958911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:48.019894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:48.020398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:48.020822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:48.206959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:48.207420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:48.207864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:48.267531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:48.268014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:48.268528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.2665 - val_loss: 0.1974 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2180
2023-11-26 16:43:48.740979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:48.741915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:48.742457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:48.803335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:48.803758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:48.804141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.2394 - val_loss: 0.2007 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.2142 - val_loss: 0.1635 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1995 - val_loss: 0.1604 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1851 - val_loss: 0.1557 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1759 - val_loss: 0.1434 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1622 - val_loss: 0.1475 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1552 - val_loss: 0.1384 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1485 - val_loss: 0.1316 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1372 - val_loss: 0.1345 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1297 - val_loss: 0.1299 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1259 - val_loss: 0.1211 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1201 - val_loss: 0.1155 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1134 - val_loss: 0.1136 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1082 - val_loss: 0.1134 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1027 - val_loss: 0.1208 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1027 - val_loss: 0.1130 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1011 - val_loss: 0.0984 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0976 - val_loss: 0.0965 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0939 - val_loss: 0.0964 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0990 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.1007 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0986 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.0953 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0959 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.0971 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0957 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0956 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0947 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0947 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0958 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0954 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.0947 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0949 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0810 - val_loss: 0.0944 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.0944 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0946 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0948 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0949 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0808 - val_loss: 0.0948 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.0948 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0948 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0949 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.0949 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.0949 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0948 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.0948 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0948 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.0948 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0948 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.0948 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0948 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0948 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0948 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0948 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0948 - lr: 2.2603e-09
Epoch 1/100
2023-11-26 16:43:53.243191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:53.243566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:53.243918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:53.302437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:53.302817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:53.303158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:53.387798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:53.388253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:53.388670: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:53.449815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:53.450455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:53.450911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:53.688085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:53.688575: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:53.689204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:53.749530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:53.749985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:53.750403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 15ms/step - loss: 0.2449 - val_loss: 0.2314 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1688
2023-11-26 16:43:54.414936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:54.415738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:54.416206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:43:54.479736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:43:54.480224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:43:54.480666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.2119 - val_loss: 0.2051 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1915 - val_loss: 0.1882 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1760 - val_loss: 0.1711 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1658 - val_loss: 0.1561 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1545 - val_loss: 0.1458 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1445 - val_loss: 0.1350 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1382 - val_loss: 0.1281 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1301 - val_loss: 0.1229 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1240 - val_loss: 0.1178 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1152 - val_loss: 0.1076 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1077 - val_loss: 0.1069 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1013 - val_loss: 0.0895 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0955 - val_loss: 0.0979 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0929 - val_loss: 0.0858 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0869 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.0877 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0898 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.0876 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0824 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0856 - val_loss: 0.0798 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0778 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0762 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0747 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0754 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0770 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0756 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0750 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0750 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0755 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0755 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0749 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0753 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0753 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0755 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0692 - val_loss: 0.0752 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0752 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0752 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0691 - val_loss: 0.0752 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0752 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0752 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0752 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0752 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0752 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:44:00.220942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:00.221409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:00.222010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:00.279680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:00.280081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:00.280458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:00.365275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:00.365782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:00.366190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:00.430052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:00.430946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:00.431456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:00.668556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:00.669081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:00.669694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:00.727465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:00.727951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:00.728385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 12ms/step - loss: 0.2257 - val_loss: 0.2097 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1804
2023-11-26 16:44:01.445639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:01.446118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:01.446791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:01.508370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:01.508875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:01.509394: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.1926 - val_loss: 0.1985 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1723 - val_loss: 0.1697 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1520 - val_loss: 0.1515 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1380 - val_loss: 0.1354 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1269 - val_loss: 0.1313 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1170 - val_loss: 0.1158 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1074 - val_loss: 0.1073 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.1091 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0979 - val_loss: 0.1004 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0957 - val_loss: 0.0950 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0974 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0880 - val_loss: 0.0923 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0886 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0927 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0900 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.0908 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.0919 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.0937 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.0987 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.1115 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0871 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0769 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0722 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0713 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0705 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0698 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0693 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0692 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0688 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0686 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0685 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0684 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0683 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0682 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0682 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0682 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0681 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0681 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0681 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0681 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0681 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0681 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0681 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0681 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0681 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0681 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0681 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0681 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0681 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0681 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0681 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.0681 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0681 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0681 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0681 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0681 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0681 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0681 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0681 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0681 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0681 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0681 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0681 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0681 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0681 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0681 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0681 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0681 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0681 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0681 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0681 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0681 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0681 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0681 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0681 - lr: 1.1370e-14
Epoch 1/100
2023-11-26 16:44:14.048266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:14.048805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:14.049257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:14.103973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:14.104353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:14.104710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:14.189251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:14.189729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:14.190155: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:14.251630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:14.252161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:14.252623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:14.491961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:14.492441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:14.492907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:14.551969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:14.552450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:14.552864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 11ms/step - loss: 0.2307 - val_loss: 0.2007 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1591
2023-11-26 16:44:15.292164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:15.292624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:15.293123: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:15.357875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:15.358330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:15.358800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.1861 - val_loss: 0.1713 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1612 - val_loss: 0.1546 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1401 - val_loss: 0.1398 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1263 - val_loss: 0.1293 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1156 - val_loss: 0.1200 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1049 - val_loss: 0.1112 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.1057 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.0999 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0923 - val_loss: 0.0980 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0902 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0896 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.0868 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.0849 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0724 - val_loss: 0.0820 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0800 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0788 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0842 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0787 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0675 - val_loss: 0.0754 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0639 - val_loss: 0.0749 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0751 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0747 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0738 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0740 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0733 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0733 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0724 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0721 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0717 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0717 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0717 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0718 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0718 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0718 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0719 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0719 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0719 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0719 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0719 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0719 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0719 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0719 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0719 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0719 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0719 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0719 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0719 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0719 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0719 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0719 - lr: 2.7536e-08
Average Validation Loss: 0.09256527870893479
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:44:25.617409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:25.617880: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:25.618246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:25.671933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:25.672319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:25.672682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:26.175779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:26.176406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:26.176834: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:26.235910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:26.236364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:26.236738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:26.472250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:26.472856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:26.473303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:26.534021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:26.534841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:26.535357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 2s 68ms/step - loss: 0.3136 - val_loss: 0.2556 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.2095
2023-11-26 16:44:27.107528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:27.108090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:27.109604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:27.172023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:27.172487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:27.172879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 10ms/step - loss: 0.2255 - val_loss: 0.2622 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2306 - val_loss: 0.2715 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2372 - val_loss: 0.2625 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2239 - val_loss: 0.2431 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2108 - val_loss: 0.2261 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2037 - val_loss: 0.2181 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1943 - val_loss: 0.2179 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1901 - val_loss: 0.2189 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1862 - val_loss: 0.2154 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1807 - val_loss: 0.2085 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1696 - val_loss: 0.2038 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1638 - val_loss: 0.1994 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1569 - val_loss: 0.1904 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1482 - val_loss: 0.1885 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1402 - val_loss: 0.1811 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1365 - val_loss: 0.1831 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1343 - val_loss: 0.1829 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1316 - val_loss: 0.1795 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1312 - val_loss: 0.1845 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1285 - val_loss: 0.1768 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1256 - val_loss: 0.1769 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1272 - val_loss: 0.1774 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1249 - val_loss: 0.1771 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1251 - val_loss: 0.1751 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1235 - val_loss: 0.1745 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1236 - val_loss: 0.1745 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1224 - val_loss: 0.1745 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1234 - val_loss: 0.1752 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1214 - val_loss: 0.1754 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1224 - val_loss: 0.1753 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1227 - val_loss: 0.1746 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1232 - val_loss: 0.1740 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1233 - val_loss: 0.1733 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1202 - val_loss: 0.1730 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1219 - val_loss: 0.1729 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1219 - val_loss: 0.1729 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1218 - val_loss: 0.1729 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1237 - val_loss: 0.1730 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1227 - val_loss: 0.1731 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1218 - val_loss: 0.1732 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1221 - val_loss: 0.1732 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1229 - val_loss: 0.1732 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1231 - val_loss: 0.1732 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1226 - val_loss: 0.1732 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1228 - val_loss: 0.1732 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1210 - val_loss: 0.1732 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1205 - val_loss: 0.1732 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1242 - val_loss: 0.1732 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1209 - val_loss: 0.1732 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1229 - val_loss: 0.1732 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1225 - val_loss: 0.1732 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1213 - val_loss: 0.1732 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1216 - val_loss: 0.1732 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1215 - val_loss: 0.1732 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1226 - val_loss: 0.1732 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1227 - val_loss: 0.1732 - lr: 1.3710e-09
Epoch 1/100
2023-11-26 16:44:30.012780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:30.013415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:30.013823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:30.070862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:30.071290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:30.071658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:30.159109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:30.159608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:30.160007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:30.224357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:30.225029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:30.225521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:30.476477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:30.477033: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:30.477615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:30.538944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:30.539476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:30.539971: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 40ms/step - loss: 0.2798 - val_loss: 0.2039 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2513
2023-11-26 16:44:31.156778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:31.157451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:31.157862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:31.227368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:31.227833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:31.228237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 8ms/step - loss: 0.2350 - val_loss: 0.1946 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2167 - val_loss: 0.1817 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 9ms/step - loss: 0.2026 - val_loss: 0.1750 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1892 - val_loss: 0.1705 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1747 - val_loss: 0.1723 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1678 - val_loss: 0.1611 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1599 - val_loss: 0.1546 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1521 - val_loss: 0.1497 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1457 - val_loss: 0.1496 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1402 - val_loss: 0.1369 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1328 - val_loss: 0.1370 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1284 - val_loss: 0.1326 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1229 - val_loss: 0.1308 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1195 - val_loss: 0.1258 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1167 - val_loss: 0.1242 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1148 - val_loss: 0.1209 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1115 - val_loss: 0.1223 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1104 - val_loss: 0.1222 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1098 - val_loss: 0.1192 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1081 - val_loss: 0.1182 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1070 - val_loss: 0.1166 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1054 - val_loss: 0.1181 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1052 - val_loss: 0.1141 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1046 - val_loss: 0.1151 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1040 - val_loss: 0.1149 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1030 - val_loss: 0.1150 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1035 - val_loss: 0.1148 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1031 - val_loss: 0.1155 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1030 - val_loss: 0.1153 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1030 - val_loss: 0.1142 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1023 - val_loss: 0.1142 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1036 - val_loss: 0.1150 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1021 - val_loss: 0.1150 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1026 - val_loss: 0.1145 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1142 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1142 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1018 - val_loss: 0.1143 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1029 - val_loss: 0.1144 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1025 - val_loss: 0.1144 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1019 - val_loss: 0.1144 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1018 - val_loss: 0.1143 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1020 - val_loss: 0.1143 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1026 - val_loss: 0.1143 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:44:34.563191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:34.563849: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:34.564280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:34.623992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:34.624417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:34.624783: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:34.711356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:34.712010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:34.712466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:34.774894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:34.775654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:34.776096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:35.024587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:35.025131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:35.025679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:35.087167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:35.087704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:35.088187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 27ms/step - loss: 0.2408 - val_loss: 0.2253 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2433
2023-11-26 16:44:35.729854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:35.730328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:35.731014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:35.793777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:35.794223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:35.794609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 7ms/step - loss: 0.2156 - val_loss: 0.2186 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1966 - val_loss: 0.1957 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1887 - val_loss: 0.1826 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1755 - val_loss: 0.1687 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1661 - val_loss: 0.1530 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1567 - val_loss: 0.1387 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1456 - val_loss: 0.1299 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1353 - val_loss: 0.1277 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1303 - val_loss: 0.1209 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1276 - val_loss: 0.1127 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1247 - val_loss: 0.1218 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1144 - val_loss: 0.1118 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1074 - val_loss: 0.1023 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1045 - val_loss: 0.0990 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1027 - val_loss: 0.0983 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1005 - val_loss: 0.0981 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0977 - val_loss: 0.0961 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0941 - val_loss: 0.0931 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0923 - val_loss: 0.0900 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0909 - val_loss: 0.0893 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0910 - val_loss: 0.0896 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0891 - val_loss: 0.0885 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0890 - val_loss: 0.0895 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0879 - val_loss: 0.0878 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0870 - val_loss: 0.0876 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0882 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0890 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0872 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0874 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0859 - val_loss: 0.0877 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0875 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0848 - val_loss: 0.0866 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0853 - val_loss: 0.0867 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0865 - val_loss: 0.0871 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0872 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0857 - val_loss: 0.0872 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0853 - val_loss: 0.0872 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0858 - val_loss: 0.0872 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0857 - val_loss: 0.0872 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0857 - val_loss: 0.0872 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0848 - val_loss: 0.0872 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0849 - val_loss: 0.0872 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0872 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0849 - val_loss: 0.0872 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0872 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0854 - val_loss: 0.0872 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0872 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0848 - val_loss: 0.0872 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0845 - val_loss: 0.0872 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0851 - val_loss: 0.0872 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0872 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0849 - val_loss: 0.0872 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:44:41.262940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:41.263613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:41.264011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:41.321584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:41.322014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:41.322401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:41.403568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:41.404065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:41.404476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:41.465403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:41.466094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:41.466566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:41.702844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:41.703300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:41.703786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:41.761933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:41.762382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:41.762810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 22ms/step - loss: 0.2399 - val_loss: 0.2208 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2379
2023-11-26 16:44:42.404142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:42.404627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:42.405295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:42.466189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:42.466654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:42.467061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 8ms/step - loss: 0.2126 - val_loss: 0.2117 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1938 - val_loss: 0.1937 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1774 - val_loss: 0.1962 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1696 - val_loss: 0.1886 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1612 - val_loss: 0.1651 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1469 - val_loss: 0.1529 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1385 - val_loss: 0.1573 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1331 - val_loss: 0.1568 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1312 - val_loss: 0.1454 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1257 - val_loss: 0.1345 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1201 - val_loss: 0.1276 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1125 - val_loss: 0.1234 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1096 - val_loss: 0.1210 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1062 - val_loss: 0.1176 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1043 - val_loss: 0.1127 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1006 - val_loss: 0.1094 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0988 - val_loss: 0.1092 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0985 - val_loss: 0.1044 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0970 - val_loss: 0.0976 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0931 - val_loss: 0.0967 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0930 - val_loss: 0.0926 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0910 - val_loss: 0.0900 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0893 - val_loss: 0.0917 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0897 - val_loss: 0.0878 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0880 - val_loss: 0.0887 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0881 - val_loss: 0.0868 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.0873 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0874 - val_loss: 0.0864 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0855 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0869 - val_loss: 0.0858 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0860 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0857 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0857 - val_loss: 0.0853 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0857 - val_loss: 0.0853 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0856 - val_loss: 0.0853 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0862 - val_loss: 0.0853 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0857 - val_loss: 0.0852 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0851 - val_loss: 0.0851 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0860 - val_loss: 0.0851 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0853 - val_loss: 0.0851 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0864 - val_loss: 0.0851 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0854 - val_loss: 0.0851 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0858 - val_loss: 0.0851 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0859 - val_loss: 0.0851 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0861 - val_loss: 0.0851 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0856 - val_loss: 0.0851 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0862 - val_loss: 0.0851 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0858 - val_loss: 0.0851 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0851 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0859 - val_loss: 0.0851 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0855 - val_loss: 0.0851 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0851 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0851 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0854 - val_loss: 0.0851 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0851 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0858 - val_loss: 0.0851 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0862 - val_loss: 0.0851 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0859 - val_loss: 0.0851 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0865 - val_loss: 0.0851 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0851 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0851 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0852 - val_loss: 0.0851 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0857 - val_loss: 0.0851 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0863 - val_loss: 0.0851 - lr: 1.5230e-11
Epoch 1/100
2023-11-26 16:44:50.786326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:50.786792: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:50.787305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:50.844111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:50.844532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:50.844891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:50.932096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:50.932601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:50.933022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:50.996722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:50.997398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:50.997875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:51.237814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:51.238532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:51.239003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:51.300318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:51.300850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:51.301659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 19ms/step - loss: 0.2337 - val_loss: 0.2147 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2091
2023-11-26 16:44:52.020692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:52.021241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:52.021917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:44:52.087279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:44:52.087784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:44:52.088210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 7ms/step - loss: 0.2048 - val_loss: 0.1942 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1913 - val_loss: 0.1849 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1810 - val_loss: 0.1766 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1639 - val_loss: 0.1611 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1532 - val_loss: 0.1532 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1468 - val_loss: 0.1489 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1404 - val_loss: 0.1443 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1332 - val_loss: 0.1385 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1277 - val_loss: 0.1324 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1243 - val_loss: 0.1319 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1197 - val_loss: 0.1287 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1136 - val_loss: 0.1236 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1094 - val_loss: 0.1213 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1067 - val_loss: 0.1192 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1027 - val_loss: 0.1160 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0977 - val_loss: 0.1117 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0939 - val_loss: 0.1080 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0926 - val_loss: 0.1080 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0890 - val_loss: 0.1057 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0873 - val_loss: 0.1036 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0849 - val_loss: 0.1003 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0824 - val_loss: 0.0950 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0797 - val_loss: 0.0905 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0770 - val_loss: 0.0886 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0764 - val_loss: 0.0870 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0750 - val_loss: 0.0852 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0748 - val_loss: 0.0848 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0848 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0846 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.0841 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0839 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0837 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0836 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0732 - val_loss: 0.0836 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0733 - val_loss: 0.0836 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.0835 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0736 - val_loss: 0.0835 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0736 - val_loss: 0.0834 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0733 - val_loss: 0.0834 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0732 - val_loss: 0.0834 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.0833 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0733 - val_loss: 0.0833 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0727 - val_loss: 0.0833 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0833 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0833 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0733 - val_loss: 0.0833 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0833 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0735 - val_loss: 0.0833 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.0833 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0833 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0733 - val_loss: 0.0833 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0735 - val_loss: 0.0833 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0833 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0833 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0733 - val_loss: 0.0833 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0833 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0730 - val_loss: 0.0833 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0735 - val_loss: 0.0833 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0732 - val_loss: 0.0833 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0833 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0730 - val_loss: 0.0833 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0737 - val_loss: 0.0833 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0736 - val_loss: 0.0833 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0833 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0833 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.0833 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0833 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0833 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0833 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0735 - val_loss: 0.0833 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.0833 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0735 - val_loss: 0.0833 - lr: 9.2853e-14
Average Validation Loss: 0.10839229673147202
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:45:03.541657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:03.542145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:03.542745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:03.593751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:03.594157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:03.594508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:03.676555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:03.677029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:03.677440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:03.737711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:03.738166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:03.738592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:03.972078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:03.972522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:03.972957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:04.031056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:04.031513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:04.031928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 2s 19ms/step - loss: 0.2161 - val_loss: 0.2513 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.2309
2023-11-26 16:45:05.041083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:05.041525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:05.042013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:05.105235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:05.105696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:05.106082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.2222 - val_loss: 0.2192 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.2022 - val_loss: 0.2120 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1891 - val_loss: 0.2039 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1827 - val_loss: 0.1928 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1683 - val_loss: 0.1876 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1632 - val_loss: 0.1805 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1510 - val_loss: 0.1794 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1508 - val_loss: 0.1687 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1291 - val_loss: 0.1946 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1406 - val_loss: 0.1524 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1089 - val_loss: 0.1450 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1009 - val_loss: 0.1411 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.1456 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0884 - val_loss: 0.1328 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.1278 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1256 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.1265 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.1566 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0908 - val_loss: 0.1226 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0776 - val_loss: 0.1272 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.1270 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.1245 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0752 - val_loss: 0.1268 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.1249 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.1241 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.1239 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.1244 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.1233 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.1259 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.1238 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.1223 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.1211 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.1223 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.1228 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.1227 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1231 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.1235 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.1235 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.1233 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.1234 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.1233 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.1232 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.1232 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.1232 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.1232 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.1232 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0724 - val_loss: 0.1232 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.1232 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0720 - val_loss: 0.1232 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.1232 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.1232 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.1232 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:45:09.561827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:09.562552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:09.562991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:09.614752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:09.615139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:09.615481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:09.698555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:09.699056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:09.699533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:09.759701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:09.760194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:09.760613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:09.946405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:09.946872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:09.947411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:10.004427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:10.004930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:10.005361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.2341 - val_loss: 0.2029 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1292
2023-11-26 16:45:10.515930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:10.516456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:10.516860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:10.578079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:10.578554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:10.578961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.2134 - val_loss: 0.1517 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1940 - val_loss: 0.1480 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1763 - val_loss: 0.1340 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1667 - val_loss: 0.1261 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1591 - val_loss: 0.1210 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1502 - val_loss: 0.1129 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1428 - val_loss: 0.1141 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1394 - val_loss: 0.1062 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1317 - val_loss: 0.1051 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1236 - val_loss: 0.1150 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1153 - val_loss: 0.1010 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1135 - val_loss: 0.0949 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1045 - val_loss: 0.1018 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0938 - val_loss: 0.1089 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0937 - val_loss: 0.0988 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0944 - val_loss: 0.0848 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0907 - val_loss: 0.0790 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0889 - val_loss: 0.0781 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0819 - val_loss: 0.0791 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0791 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0796 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0742 - val_loss: 0.0809 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0820 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0701 - val_loss: 0.0851 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0847 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0858 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0843 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0832 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0676 - val_loss: 0.0844 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0854 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0686 - val_loss: 0.0856 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0859 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0856 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0668 - val_loss: 0.0858 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0856 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0855 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0854 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0854 - lr: 3.3460e-06
Epoch 1/100
2023-11-26 16:45:14.863553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:14.863951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:14.864297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:14.920743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:14.921149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:14.921496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:15.005504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:15.005979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:15.006389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:15.069240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:15.069937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:15.070401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:15.311584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:15.312051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:15.312610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:15.370533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:15.370985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:15.371399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.2173 - val_loss: 0.1960 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1874
2023-11-26 16:45:16.105319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:16.105745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:16.106133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:16.170224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:16.170684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:16.171051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1897 - val_loss: 0.1737 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1703 - val_loss: 0.1574 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1547 - val_loss: 0.1419 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1469 - val_loss: 0.1364 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1379 - val_loss: 0.1267 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1343 - val_loss: 0.1236 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1290 - val_loss: 0.1187 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1258 - val_loss: 0.1197 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1216 - val_loss: 0.1103 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1178 - val_loss: 0.1114 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1112 - val_loss: 0.1037 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1043 - val_loss: 0.1030 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1012 - val_loss: 0.0935 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0967 - val_loss: 0.0934 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0912 - val_loss: 0.0886 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0874 - val_loss: 0.0831 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0812 - val_loss: 0.0797 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0803 - val_loss: 0.0824 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0740 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.0726 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0683 - val_loss: 0.0687 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0688 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0634 - val_loss: 0.0663 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0660 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0651 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0639 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0640 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.0662 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0628 - val_loss: 0.0680 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0676 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0680 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0671 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0673 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0674 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0675 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0676 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0674 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0673 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0673 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0673 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0673 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0673 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0597 - val_loss: 0.0673 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0672 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0672 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0672 - lr: 1.5073e-07
Epoch 1/100
2023-11-26 16:45:25.044316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:25.044722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:25.045329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:25.103093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:25.103500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:25.103853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:25.184552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:25.185045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:25.185465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:25.247162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:25.247659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:25.248073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:25.500933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:25.501407: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:25.501850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:25.560020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:25.560505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:25.560963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.2116 - val_loss: 0.1983 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1985
2023-11-26 16:45:26.343387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:26.343806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:26.344351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:26.406300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:26.406761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:26.407151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1748 - val_loss: 0.1796 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1588 - val_loss: 0.1530 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1454 - val_loss: 0.1422 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1348 - val_loss: 0.1269 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1257 - val_loss: 0.1243 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1188 - val_loss: 0.1223 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1107 - val_loss: 0.1166 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1049 - val_loss: 0.1373 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1017 - val_loss: 0.1129 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.1087 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0869 - val_loss: 0.1133 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0837 - val_loss: 0.1072 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0814 - val_loss: 0.0990 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0899 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0746 - val_loss: 0.0864 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0858 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0706 - val_loss: 0.0828 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0698 - val_loss: 0.0809 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0676 - val_loss: 0.0793 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0795 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0786 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0646 - val_loss: 0.0797 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.0768 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0630 - val_loss: 0.0787 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.0766 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0748 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.0714 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0674 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0663 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0614 - val_loss: 0.0647 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0642 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0597 - val_loss: 0.0637 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0635 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0633 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0632 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0632 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0631 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0631 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0630 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0630 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0630 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0630 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0630 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0630 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0630 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0630 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0630 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0630 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0630 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0630 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0630 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0630 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0630 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0630 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0630 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0630 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0630 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0630 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0630 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0630 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0630 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0630 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0630 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0630 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0630 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0630 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0630 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0630 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0630 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0630 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0630 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0630 - lr: 6.9144e-16
Epoch 1/100
2023-11-26 16:45:45.455028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:45.455402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:45.455736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:45.510292: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:45.510675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:45.511029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:45.592960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:45.593421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:45.593759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:45.654508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:45.654970: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:45.655385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:45.890676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:45.891320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:45.891754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:45.949685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:45.950177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:45.950605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 7ms/step - loss: 0.2108 - val_loss: 0.1796 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1301
2023-11-26 16:45:46.790575: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:46.791007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:46.791426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:45:46.853576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:45:46.854044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:45:46.854452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1672 - val_loss: 0.1494 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1463 - val_loss: 0.1358 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1342 - val_loss: 0.1258 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1223 - val_loss: 0.1185 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1159 - val_loss: 0.1127 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1113 - val_loss: 0.1080 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1054 - val_loss: 0.1041 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0999 - val_loss: 0.1001 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0948 - val_loss: 0.0975 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0913 - val_loss: 0.0940 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0838 - val_loss: 0.0900 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0792 - val_loss: 0.0886 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.0863 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.0854 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0699 - val_loss: 0.0845 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0667 - val_loss: 0.0857 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0650 - val_loss: 0.0839 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0628 - val_loss: 0.0803 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0794 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0814 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0762 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0743 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0736 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0735 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0732 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0727 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0726 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0723 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0720 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0717 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0716 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0712 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0712 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0711 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0711 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0710 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0710 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0710 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0709 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0709 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0709 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0709 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0709 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0709 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0709 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0709 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0709 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0709 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0709 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0709 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0709 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0709 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0709 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0709 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0709 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0709 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0709 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0709 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0709 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0709 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0709 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0709 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0709 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0709 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0709 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0709 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0709 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0709 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0709 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0709 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0709 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0709 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0709 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0709 - lr: 2.2897e-14
Average Validation Loss: 0.07941384613513947
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 16:46:08.961963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:08.962573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:08.963006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:09.019328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:09.019776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:09.020178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:09.108544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:09.109028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:09.109454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:09.171269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:09.171900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:09.172390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:09.419581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:09.420040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:09.420468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:09.478898: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:09.479342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:09.479771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 38ms/step - loss: 0.2305 - val_loss: 0.2780 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2194
2023-11-26 16:46:10.065801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:10.066278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:10.066918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:10.128425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:10.128874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:10.129265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 7ms/step - loss: 0.2361 - val_loss: 0.2644 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2196 - val_loss: 0.2217 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2044 - val_loss: 0.2131 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1907 - val_loss: 0.2163 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1868 - val_loss: 0.2137 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1814 - val_loss: 0.2023 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1751 - val_loss: 0.1968 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1620 - val_loss: 0.1945 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1567 - val_loss: 0.1864 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1393 - val_loss: 0.1813 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1227 - val_loss: 0.1901 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1178 - val_loss: 0.1740 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1144 - val_loss: 0.1662 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1110 - val_loss: 0.1759 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1121 - val_loss: 0.1796 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1090 - val_loss: 0.1541 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1048 - val_loss: 0.1770 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1059 - val_loss: 0.1724 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1021 - val_loss: 0.1535 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0992 - val_loss: 0.1733 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1021 - val_loss: 0.1566 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0996 - val_loss: 0.1698 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0992 - val_loss: 0.1576 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0972 - val_loss: 0.1644 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0969 - val_loss: 0.1648 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0967 - val_loss: 0.1597 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0962 - val_loss: 0.1589 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0973 - val_loss: 0.1590 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0957 - val_loss: 0.1609 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0955 - val_loss: 0.1623 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0957 - val_loss: 0.1613 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0953 - val_loss: 0.1602 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0965 - val_loss: 0.1594 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0963 - val_loss: 0.1592 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0959 - val_loss: 0.1593 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0952 - val_loss: 0.1599 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0969 - val_loss: 0.1602 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0956 - val_loss: 0.1603 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0952 - val_loss: 0.1602 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:46:12.533752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:12.534428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:12.534779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:12.591237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:12.591632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:12.592074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:12.676873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:12.677382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:12.677874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:12.739131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:12.739740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:12.740182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:12.924610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:12.925064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:12.925486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:12.984135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:12.984684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:12.985100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.2466 - val_loss: 0.1833 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1852
2023-11-26 16:46:13.873805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:13.874326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:13.874916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:13.939034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:13.939535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:13.939937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.2190 - val_loss: 0.1818 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.2024 - val_loss: 0.1515 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1868 - val_loss: 0.1566 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1751 - val_loss: 0.1492 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1642 - val_loss: 0.1422 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1524 - val_loss: 0.1371 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1436 - val_loss: 0.1404 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1370 - val_loss: 0.1333 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1320 - val_loss: 0.1273 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1237 - val_loss: 0.1255 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1169 - val_loss: 0.1241 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1118 - val_loss: 0.1231 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1077 - val_loss: 0.1199 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1042 - val_loss: 0.1179 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0995 - val_loss: 0.1190 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1001 - val_loss: 0.1141 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0977 - val_loss: 0.1150 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0951 - val_loss: 0.1058 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.1065 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.1064 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.1077 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.1058 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.1053 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.1038 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.1054 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.1046 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.1039 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0847 - val_loss: 0.1062 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1040 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.1046 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.1036 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1031 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1036 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.1041 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.1044 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1045 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.1047 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.1048 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.1048 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.1047 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.1047 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.1046 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.1046 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.1046 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.1046 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.1046 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1046 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1046 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.1046 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1046 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0838 - val_loss: 0.1046 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.1046 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:46:18.202083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:18.202490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:18.203111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:18.257615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:18.258018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:18.258380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:18.343712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:18.344189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:18.344604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:18.405136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:18.405845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:18.406434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:18.644733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:18.645203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:18.645669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:18.704622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:18.705115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:18.705545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 15ms/step - loss: 0.2336 - val_loss: 0.2142 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1559
2023-11-26 16:46:19.366528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:19.367027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:19.367676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:19.432744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:19.433168: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:19.433535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.2009 - val_loss: 0.1879 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1792 - val_loss: 0.1658 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1662 - val_loss: 0.1517 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1538 - val_loss: 0.1415 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1446 - val_loss: 0.1346 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1367 - val_loss: 0.1268 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1285 - val_loss: 0.1188 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1207 - val_loss: 0.1145 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1137 - val_loss: 0.1022 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1083 - val_loss: 0.1037 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1020 - val_loss: 0.0888 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0977 - val_loss: 0.0906 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0838 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.0838 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0863 - val_loss: 0.0801 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.0831 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0864 - val_loss: 0.0838 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.0846 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0771 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0778 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0790 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.0789 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.0770 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0773 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0774 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0782 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.0760 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0770 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0764 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0762 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0765 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0762 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0767 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0767 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0764 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0763 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0762 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0763 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0763 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0762 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0762 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0763 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0763 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0763 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0763 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0763 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0763 - lr: 1.0104e-07
Epoch 1/100
2023-11-26 16:46:25.706386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:25.706751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:25.707094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:25.762829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:25.763213: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:25.763556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:25.848559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:25.849048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:25.849480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:25.910339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:25.910960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:25.911419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:26.157425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:26.157891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:26.158327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:26.216329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:26.216777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:26.217199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 12ms/step - loss: 0.2338 - val_loss: 0.1995 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1546
2023-11-26 16:46:26.907054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:26.907631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:26.908096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:26.969600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:26.970062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:26.970462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.1888 - val_loss: 0.1906 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1720 - val_loss: 0.1714 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1526 - val_loss: 0.1447 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1372 - val_loss: 0.1364 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1266 - val_loss: 0.1221 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1172 - val_loss: 0.1168 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1097 - val_loss: 0.1087 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1041 - val_loss: 0.1091 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.1052 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0946 - val_loss: 0.1017 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0935 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0878 - val_loss: 0.1005 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0959 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.0949 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0967 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.0987 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0973 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.1016 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.1017 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.1085 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.1074 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0884 - val_loss: 0.0859 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0809 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.0778 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0764 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0752 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0746 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0743 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0740 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0739 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0740 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0739 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0739 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0738 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0737 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0737 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0737 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0736 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0736 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0736 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0736 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0736 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0736 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0736 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0736 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.0736 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0736 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0736 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0736 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0736 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0736 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0736 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0736 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0736 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0736 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.0736 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0736 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0736 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0736 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0736 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0736 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0736 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0736 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0736 - lr: 1.5230e-11
Epoch 1/100
2023-11-26 16:46:37.829211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:37.829647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:37.830323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:37.889707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:37.890119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:37.890504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:37.980634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:37.981132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:37.981624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:38.049465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:38.050184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:38.050632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:38.298544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:38.299000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:38.299545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:38.358759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:38.359274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:38.359718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 11ms/step - loss: 0.2154 - val_loss: 0.1851 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1424
2023-11-26 16:46:39.103334: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:39.103816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:39.104445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:39.170914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:39.171584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:39.172122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.1762 - val_loss: 0.1575 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1537 - val_loss: 0.1379 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1375 - val_loss: 0.1274 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1275 - val_loss: 0.1225 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1194 - val_loss: 0.1144 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1143 - val_loss: 0.1114 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1063 - val_loss: 0.1062 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1003 - val_loss: 0.1012 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0930 - val_loss: 0.0967 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.1110 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.1118 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0924 - val_loss: 0.0920 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0944 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0896 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0844 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0832 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0724 - val_loss: 0.0783 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0680 - val_loss: 0.0760 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0670 - val_loss: 0.0771 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0663 - val_loss: 0.0717 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0712 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0615 - val_loss: 0.0702 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0693 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0689 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0680 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0675 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0670 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0667 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0665 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0667 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0668 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0669 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0669 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0669 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0668 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0670 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0670 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0669 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0669 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0669 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0572 - val_loss: 0.0669 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0669 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0669 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0669 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0570 - val_loss: 0.0669 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0669 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0669 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0669 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0669 - lr: 4.5400e-08
Average Validation Loss: 0.09454599916934966
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 16:46:49.057646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:49.058086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:49.058647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:49.112340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:49.112716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:49.113062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:49.193716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:49.194202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:49.194632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:49.255232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:49.255773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:49.256277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:49.493882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:49.494436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:49.494851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:49.552877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:49.553356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:49.553782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 67ms/step - loss: 0.3065 - val_loss: 0.2447 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1905
2023-11-26 16:46:50.107054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:50.107535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:50.108219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:50.170082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:50.170546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:50.170931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 11ms/step - loss: 0.2118 - val_loss: 0.2458 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2163 - val_loss: 0.2574 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2205 - val_loss: 0.2500 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2102 - val_loss: 0.2317 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1988 - val_loss: 0.2136 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1910 - val_loss: 0.2038 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1795 - val_loss: 0.2040 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1734 - val_loss: 0.2088 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1707 - val_loss: 0.2033 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 12ms/step - loss: 0.1657 - val_loss: 0.1945 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1545 - val_loss: 0.1913 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1506 - val_loss: 0.1897 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1423 - val_loss: 0.1916 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1392 - val_loss: 0.1837 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1339 - val_loss: 0.1812 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1315 - val_loss: 0.1826 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1276 - val_loss: 0.1799 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1280 - val_loss: 0.1780 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1236 - val_loss: 0.1805 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1256 - val_loss: 0.1750 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1220 - val_loss: 0.1750 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1216 - val_loss: 0.1760 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1203 - val_loss: 0.1743 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1192 - val_loss: 0.1732 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1203 - val_loss: 0.1734 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1206 - val_loss: 0.1731 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1189 - val_loss: 0.1725 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1178 - val_loss: 0.1720 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1169 - val_loss: 0.1720 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1178 - val_loss: 0.1720 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1193 - val_loss: 0.1717 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1184 - val_loss: 0.1714 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1180 - val_loss: 0.1713 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1181 - val_loss: 0.1713 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1175 - val_loss: 0.1715 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1195 - val_loss: 0.1716 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1181 - val_loss: 0.1716 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1170 - val_loss: 0.1716 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1196 - val_loss: 0.1716 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1189 - val_loss: 0.1716 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1180 - val_loss: 0.1716 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1189 - val_loss: 0.1716 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1181 - val_loss: 0.1716 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1198 - val_loss: 0.1716 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1180 - val_loss: 0.1716 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1184 - val_loss: 0.1716 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1187 - val_loss: 0.1716 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1189 - val_loss: 0.1716 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1177 - val_loss: 0.1716 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1171 - val_loss: 0.1716 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1168 - val_loss: 0.1716 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1176 - val_loss: 0.1716 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1187 - val_loss: 0.1716 - lr: 6.1442e-09
Epoch 1/100
2023-11-26 16:46:52.890454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:52.890881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:52.891323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:52.944958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:52.945356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:52.945710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:53.029912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:53.030408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:53.030823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:53.090875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:53.091387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:53.091860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:53.333098: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:53.333883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:53.334297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:53.393215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:53.393678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:53.394105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 38ms/step - loss: 0.2583 - val_loss: 0.1884 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2491
2023-11-26 16:46:53.995682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:53.996203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:53.996978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:54.064420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:54.064915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:54.065329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 9ms/step - loss: 0.2308 - val_loss: 0.1766 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 9ms/step - loss: 0.2133 - val_loss: 0.1835 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 9ms/step - loss: 0.2032 - val_loss: 0.1660 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1911 - val_loss: 0.1602 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1756 - val_loss: 0.1617 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1658 - val_loss: 0.1529 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1590 - val_loss: 0.1459 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1466 - val_loss: 0.1472 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1391 - val_loss: 0.1411 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1339 - val_loss: 0.1327 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1269 - val_loss: 0.1316 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1228 - val_loss: 0.1252 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1181 - val_loss: 0.1227 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1163 - val_loss: 0.1202 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1130 - val_loss: 0.1242 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1109 - val_loss: 0.1216 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1091 - val_loss: 0.1138 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1069 - val_loss: 0.1194 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1055 - val_loss: 0.1143 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1041 - val_loss: 0.1155 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1024 - val_loss: 0.1125 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1030 - val_loss: 0.1117 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1020 - val_loss: 0.1125 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1017 - val_loss: 0.1112 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1003 - val_loss: 0.1118 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0999 - val_loss: 0.1111 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1003 - val_loss: 0.1105 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0999 - val_loss: 0.1100 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0998 - val_loss: 0.1097 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0991 - val_loss: 0.1108 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0989 - val_loss: 0.1107 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0987 - val_loss: 0.1101 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0986 - val_loss: 0.1095 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0985 - val_loss: 0.1097 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0992 - val_loss: 0.1099 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0993 - val_loss: 0.1101 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0996 - val_loss: 0.1102 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0978 - val_loss: 0.1103 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0994 - val_loss: 0.1103 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0989 - val_loss: 0.1103 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0993 - val_loss: 0.1103 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0991 - val_loss: 0.1103 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0987 - val_loss: 0.1103 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0992 - val_loss: 0.1103 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0989 - val_loss: 0.1103 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0981 - val_loss: 0.1103 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0992 - val_loss: 0.1103 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0987 - val_loss: 0.1103 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0984 - val_loss: 0.1103 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0993 - val_loss: 0.1103 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0999 - val_loss: 0.1103 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0988 - val_loss: 0.1103 - lr: 1.0130e-08
Epoch 54/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0980 - val_loss: 0.1103 - lr: 6.1442e-09
Epoch 1/100
2023-11-26 16:46:58.260223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:58.260897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:58.261339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:58.318403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:58.318824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:58.319187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:58.406082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:58.406556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:58.406980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:58.469491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:58.469982: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:58.470423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:58.708437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:58.709000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:58.709613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:58.770287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:58.770857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:58.771237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 2s 27ms/step - loss: 0.2468 - val_loss: 0.2150 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2425
2023-11-26 16:46:59.835336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:59.835964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:59.836347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:46:59.902268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:46:59.902740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:46:59.903142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 8ms/step - loss: 0.2096 - val_loss: 0.2106 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1896 - val_loss: 0.1886 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1797 - val_loss: 0.1740 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1674 - val_loss: 0.1605 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1585 - val_loss: 0.1490 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1508 - val_loss: 0.1405 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1435 - val_loss: 0.1325 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1358 - val_loss: 0.1247 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1269 - val_loss: 0.1204 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1210 - val_loss: 0.1156 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1192 - val_loss: 0.1124 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1267 - val_loss: 0.1145 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1122 - val_loss: 0.1185 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1059 - val_loss: 0.1049 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1020 - val_loss: 0.0982 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0997 - val_loss: 0.0969 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1003 - val_loss: 0.1031 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0968 - val_loss: 0.1066 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0950 - val_loss: 0.1009 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0922 - val_loss: 0.0955 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0910 - val_loss: 0.0925 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0902 - val_loss: 0.0965 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0894 - val_loss: 0.0928 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0891 - val_loss: 0.0925 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0891 - val_loss: 0.0944 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0880 - val_loss: 0.0923 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0887 - val_loss: 0.0932 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0879 - val_loss: 0.0923 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0879 - val_loss: 0.0918 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0881 - val_loss: 0.0920 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0881 - val_loss: 0.0929 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0872 - val_loss: 0.0926 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0879 - val_loss: 0.0921 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0921 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0863 - val_loss: 0.0919 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0870 - val_loss: 0.0918 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0874 - val_loss: 0.0917 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0877 - val_loss: 0.0918 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0871 - val_loss: 0.0920 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0870 - val_loss: 0.0921 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0868 - val_loss: 0.0921 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0921 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0876 - val_loss: 0.0921 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0921 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0875 - val_loss: 0.0921 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0921 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0868 - val_loss: 0.0921 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0870 - val_loss: 0.0921 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0921 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0854 - val_loss: 0.0921 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0874 - val_loss: 0.0921 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0921 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0865 - val_loss: 0.0921 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0868 - val_loss: 0.0921 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0862 - val_loss: 0.0921 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0877 - val_loss: 0.0921 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0921 - lr: 8.3153e-10
Epoch 1/100
2023-11-26 16:47:05.920714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:05.921200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:05.921650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:05.975061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:05.975555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:05.975999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:06.066223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:06.066754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:06.067205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:06.131772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:06.132283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:06.132845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:06.373320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:06.373873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:06.374323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:06.431985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:06.432422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:06.432838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 22ms/step - loss: 0.2260 - val_loss: 0.2108 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2294
2023-11-26 16:47:07.087867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:07.088379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:07.088907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:07.151932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:07.152378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:07.152758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 7ms/step - loss: 0.2019 - val_loss: 0.1946 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1811 - val_loss: 0.1910 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1724 - val_loss: 0.2131 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1708 - val_loss: 0.1837 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1599 - val_loss: 0.1460 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1379 - val_loss: 0.1561 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1325 - val_loss: 0.1592 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1273 - val_loss: 0.1623 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1290 - val_loss: 0.1754 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1367 - val_loss: 0.1161 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1110 - val_loss: 0.1220 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1084 - val_loss: 0.1318 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1103 - val_loss: 0.1310 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1125 - val_loss: 0.1023 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0998 - val_loss: 0.0988 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0950 - val_loss: 0.0966 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0929 - val_loss: 0.0982 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0925 - val_loss: 0.0957 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0922 - val_loss: 0.0887 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0900 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0863 - val_loss: 0.0789 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0853 - val_loss: 0.0772 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0838 - val_loss: 0.0770 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0831 - val_loss: 0.0759 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0828 - val_loss: 0.0759 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0822 - val_loss: 0.0749 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0824 - val_loss: 0.0749 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0823 - val_loss: 0.0738 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0815 - val_loss: 0.0743 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0815 - val_loss: 0.0750 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0814 - val_loss: 0.0744 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0817 - val_loss: 0.0743 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0814 - val_loss: 0.0742 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0812 - val_loss: 0.0741 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0804 - val_loss: 0.0740 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0808 - val_loss: 0.0739 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0808 - val_loss: 0.0739 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0809 - val_loss: 0.0738 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0807 - val_loss: 0.0738 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0813 - val_loss: 0.0739 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0804 - val_loss: 0.0739 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0815 - val_loss: 0.0739 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0812 - val_loss: 0.0739 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0813 - val_loss: 0.0739 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0805 - val_loss: 0.0739 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0813 - val_loss: 0.0739 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0807 - val_loss: 0.0739 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0810 - val_loss: 0.0739 - lr: 6.7729e-08
Epoch 1/100
2023-11-26 16:47:13.363088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:13.363559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:13.364099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:13.422976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:13.423364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:13.423787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:13.509489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:13.509964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:13.510385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:13.574376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:13.575141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:13.575715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:13.815330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:13.815874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:13.816294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:13.874321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:13.874781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:13.875204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 18ms/step - loss: 0.2333 - val_loss: 0.2095 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2119
2023-11-26 16:47:14.549996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:14.550486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:14.550991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:14.612369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:14.612845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:14.613244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 7ms/step - loss: 0.1992 - val_loss: 0.1952 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1875 - val_loss: 0.1845 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1806 - val_loss: 0.1801 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1674 - val_loss: 0.1677 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1528 - val_loss: 0.1566 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1456 - val_loss: 0.1518 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1444 - val_loss: 0.1516 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1371 - val_loss: 0.1443 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1293 - val_loss: 0.1375 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1210 - val_loss: 0.1336 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1181 - val_loss: 0.1324 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1140 - val_loss: 0.1309 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1083 - val_loss: 0.1282 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1055 - val_loss: 0.1274 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1025 - val_loss: 0.1237 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0985 - val_loss: 0.1210 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0944 - val_loss: 0.1170 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0916 - val_loss: 0.1175 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0898 - val_loss: 0.1137 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0864 - val_loss: 0.1095 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0830 - val_loss: 0.1049 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0804 - val_loss: 0.1023 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0787 - val_loss: 0.1006 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0773 - val_loss: 0.0995 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0987 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0981 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0977 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0754 - val_loss: 0.0973 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0750 - val_loss: 0.0969 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0747 - val_loss: 0.0967 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0744 - val_loss: 0.0966 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0966 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0964 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0963 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0736 - val_loss: 0.0963 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0746 - val_loss: 0.0962 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0737 - val_loss: 0.0962 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.0961 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0737 - val_loss: 0.0961 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0961 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0746 - val_loss: 0.0961 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0961 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0961 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0961 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0961 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.0961 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0961 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0747 - val_loss: 0.0961 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0735 - val_loss: 0.0961 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0961 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0737 - val_loss: 0.0961 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0961 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0961 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0961 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0961 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0746 - val_loss: 0.0961 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0740 - val_loss: 0.0961 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0735 - val_loss: 0.0961 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0961 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0740 - val_loss: 0.0961 - lr: 1.6788e-10
Average Validation Loss: 0.10846413969993592
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:47:24.121197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:24.121800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:24.122185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:24.176909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:24.177305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:24.177665: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:24.261253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:24.261743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:24.262121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:24.321836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:24.322307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:24.323068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:24.564260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:24.564711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:24.565144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:24.624899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:24.625376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:24.625787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 20ms/step - loss: 0.1272 - val_loss: 0.1517 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1073
2023-11-26 16:47:25.261765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:25.262235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:25.262819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:25.327190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:25.327631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:25.328019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.1251 - val_loss: 0.1388 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1179 - val_loss: 0.1364 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1096 - val_loss: 0.1373 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1034 - val_loss: 0.1381 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1001 - val_loss: 0.1435 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0970 - val_loss: 0.1272 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1228 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0968 - val_loss: 0.1269 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.1395 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0744 - val_loss: 0.1306 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.1208 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.1233 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.1124 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.1099 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0534 - val_loss: 0.1036 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.1067 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.1115 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.1100 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0978 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.1226 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.1017 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.1121 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.1043 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.1086 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.1105 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.1107 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.1078 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0434 - val_loss: 0.1107 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.1081 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.1097 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.1084 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.1085 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0417 - val_loss: 0.1084 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0414 - val_loss: 0.1087 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0413 - val_loss: 0.1082 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.1080 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.1078 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.1079 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.1081 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:47:28.689872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:28.690322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:28.690891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:28.743256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:28.743637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:28.744010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:28.826793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:28.827287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:28.827718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:28.887549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:28.888057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:28.888526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:29.074763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:29.075217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:29.075660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:29.133601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:29.134067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:29.134490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1461 - val_loss: 0.0939 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0619
2023-11-26 16:47:29.641468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:29.642187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:29.642749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:29.705053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:29.705491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:29.705868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1346 - val_loss: 0.0812 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1240 - val_loss: 0.0887 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1218 - val_loss: 0.0873 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1166 - val_loss: 0.0711 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1146 - val_loss: 0.0905 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1090 - val_loss: 0.0753 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1079 - val_loss: 0.0746 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1027 - val_loss: 0.0887 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0992 - val_loss: 0.0765 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0967 - val_loss: 0.0839 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0919 - val_loss: 0.0811 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0886 - val_loss: 0.0784 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0836 - val_loss: 0.0770 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0728 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0702 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0706 - val_loss: 0.0710 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0667 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0698 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0662 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0622 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0625 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0629 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0666 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0689 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0679 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0686 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0699 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0689 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0692 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0704 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0698 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0688 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0698 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0699 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0703 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0706 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0706 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0706 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0705 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0706 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:47:34.193292: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:34.193954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:34.194444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:34.250823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:34.251193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:34.251540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:34.339541: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:34.340025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:34.340419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:34.403068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:34.403671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:34.404248: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:34.645578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:34.646048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:34.646751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:34.706010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:34.706482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:34.706920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.1295 - val_loss: 0.1178 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1344
2023-11-26 16:47:35.440486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:35.440984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:35.441619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:35.504223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:35.504662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:35.505035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1183 - val_loss: 0.1081 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1115 - val_loss: 0.1043 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1071 - val_loss: 0.0998 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1068 - val_loss: 0.0973 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1042 - val_loss: 0.0993 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1011 - val_loss: 0.0945 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0962 - val_loss: 0.0934 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0938 - val_loss: 0.0905 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0900 - val_loss: 0.0873 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0878 - val_loss: 0.0855 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0817 - val_loss: 0.0743 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0707 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0692 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0626 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0604 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0547 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0585 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0545 - val_loss: 0.0544 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0557 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0529 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0520 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0523 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0499 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0477 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0475 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0482 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0486 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0495 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0497 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0499 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0501 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0501 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0499 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0503 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0503 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0503 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0502 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0502 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0501 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0501 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0501 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0501 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0501 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0501 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0501 - lr: 2.2487e-07
Epoch 1/100
2023-11-26 16:47:44.259647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:44.260014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:44.260373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:44.315956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:44.316371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:44.316735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:44.401586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:44.402065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:44.402521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:44.465930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:44.466555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:44.467148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:45.146236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:45.146900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:45.147495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:45.208116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:45.208752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:45.209292: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 2s 8ms/step - loss: 0.1268 - val_loss: 0.1377 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1483
2023-11-26 16:47:46.016799: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:46.017449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:46.017976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:47:46.081483: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:47:46.081985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:47:46.082427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1154 - val_loss: 0.1108 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1092 - val_loss: 0.1055 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1042 - val_loss: 0.0904 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0964 - val_loss: 0.0854 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0885 - val_loss: 0.0944 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0832 - val_loss: 0.1022 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0790 - val_loss: 0.0905 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.0935 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.1121 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0843 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0841 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0875 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0693 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0616 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0551 - val_loss: 0.0596 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0575 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0565 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0586 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0546 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0532 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0524 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0527 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0520 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0506 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0496 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0483 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0474 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0457 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0442 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0422 - val_loss: 0.0434 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0414 - val_loss: 0.0430 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0428 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0426 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0411 - val_loss: 0.0426 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0425 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0425 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0424 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0424 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0424 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0424 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0424 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0424 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0424 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0424 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0424 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0396 - val_loss: 0.0424 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0424 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0424 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0424 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0424 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0396 - val_loss: 0.0424 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0424 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0424 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0424 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0394 - val_loss: 0.0424 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0424 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0424 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0424 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0424 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0424 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0424 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0402 - val_loss: 0.0424 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0424 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0424 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0424 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0424 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0424 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0424 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0424 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0424 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0424 - lr: 1.3924e-15
Epoch 1/100
2023-11-26 16:48:05.328119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:05.328570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:05.329181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:05.381920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:05.382318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:05.382663: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:05.464447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:05.464914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:05.465344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:05.527237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:05.527660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:05.528083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:05.766153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:05.766757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:05.767235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:05.824994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:05.825438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:05.825853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 7ms/step - loss: 0.1310 - val_loss: 0.1114 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0657
2023-11-26 16:48:06.674068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:06.674502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:06.674976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:06.735768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:06.736251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:06.736646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 4ms/step - loss: 0.1114 - val_loss: 0.1061 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1062 - val_loss: 0.1029 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0977 - val_loss: 0.0995 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0934 - val_loss: 0.0974 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0885 - val_loss: 0.0947 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0834 - val_loss: 0.0927 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.0902 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0772 - val_loss: 0.0874 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.0868 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0824 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0634 - val_loss: 0.0815 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0795 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0553 - val_loss: 0.0780 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0763 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0751 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0731 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0715 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0707 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0686 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0672 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0668 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0656 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0415 - val_loss: 0.0638 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0622 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0399 - val_loss: 0.0619 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0389 - val_loss: 0.0604 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0391 - val_loss: 0.0592 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0580 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0576 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0567 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0563 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0559 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.0556 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0554 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0553 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0553 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.0552 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0360 - val_loss: 0.0552 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0552 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0362 - val_loss: 0.0551 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0551 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0362 - val_loss: 0.0551 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0360 - val_loss: 0.0551 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0367 - val_loss: 0.0551 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0551 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0364 - val_loss: 0.0551 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0364 - val_loss: 0.0551 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0551 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0366 - val_loss: 0.0551 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0551 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0551 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0551 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.0551 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0551 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0551 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0551 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0551 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0551 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0551 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0361 - val_loss: 0.0551 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0551 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0367 - val_loss: 0.0551 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0363 - val_loss: 0.0551 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0551 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0364 - val_loss: 0.0551 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0551 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0551 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0364 - val_loss: 0.0551 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0551 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0362 - val_loss: 0.0551 - lr: 2.8039e-15
Average Validation Loss: 0.06098313182592392
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
2023-11-26 16:48:30.257824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:30.258363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:30.258920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:30.315251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:30.315642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:30.316011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:30.405216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:30.405754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:30.406200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:30.472015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:30.472888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:30.473397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:30.714245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:30.714730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:30.715165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:30.773993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:30.774448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:30.774881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1390 - val_loss: 0.1595 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0938
2023-11-26 16:48:31.373109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:31.373583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:31.374223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:31.434505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:31.434920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:31.435303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 6ms/step - loss: 0.1334 - val_loss: 0.1583 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1259 - val_loss: 0.1330 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1124 - val_loss: 0.1248 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1028 - val_loss: 0.1289 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0996 - val_loss: 0.1251 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0963 - val_loss: 0.1113 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0802 - val_loss: 0.1153 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0705 - val_loss: 0.0984 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0674 - val_loss: 0.0965 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0632 - val_loss: 0.1146 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0707 - val_loss: 0.1101 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0622 - val_loss: 0.0996 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0514 - val_loss: 0.1093 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0511 - val_loss: 0.0997 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0472 - val_loss: 0.1037 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0487 - val_loss: 0.1044 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.1037 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0457 - val_loss: 0.1031 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0456 - val_loss: 0.1032 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0468 - val_loss: 0.1003 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0449 - val_loss: 0.1023 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0452 - val_loss: 0.0989 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0447 - val_loss: 0.1004 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0457 - val_loss: 0.1014 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0453 - val_loss: 0.1009 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0453 - val_loss: 0.1004 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0443 - val_loss: 0.0982 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0449 - val_loss: 0.1004 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0456 - val_loss: 0.1013 - lr: 4.9787e-05
Epoch 1/100
2023-11-26 16:48:33.248505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:33.248953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:33.249505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:33.300759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:33.301132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:33.301476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:33.380629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:33.381090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:33.381503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:33.442070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:33.442574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:33.442988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:33.627617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:33.628082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:33.628516: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:33.686390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:33.686856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:33.687266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 18ms/step - loss: 0.1517 - val_loss: 0.0853 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0910
2023-11-26 16:48:34.145631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:34.146118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:34.146744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:34.207016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:34.207465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:34.207846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1374 - val_loss: 0.1017 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1224 - val_loss: 0.0783 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1174 - val_loss: 0.0898 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1156 - val_loss: 0.0612 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1068 - val_loss: 0.0817 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0980 - val_loss: 0.0925 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1006 - val_loss: 0.0592 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1002 - val_loss: 0.0706 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.1153 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0937 - val_loss: 0.0587 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0640 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0852 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.0684 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0656 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0656 - val_loss: 0.0707 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0643 - val_loss: 0.0689 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0645 - val_loss: 0.0649 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0645 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0601 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0637 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0632 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0633 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0629 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0632 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0640 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0632 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0666 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0646 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0640 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0649 - lr: 3.6883e-05
Epoch 1/100
2023-11-26 16:48:36.788370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:36.788891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:36.789255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:36.845766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:36.846104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:36.846450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:36.938479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:36.939020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:36.939505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:37.003558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:37.004090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:37.004614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:37.239375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:37.239843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:37.240280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:37.299177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:37.299634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:37.300044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 16ms/step - loss: 0.1410 - val_loss: 0.1287 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0729
2023-11-26 16:48:37.987706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:37.988477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:37.988929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:38.057002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:38.057406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:38.057785: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.1205 - val_loss: 0.1189 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1094 - val_loss: 0.1115 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1049 - val_loss: 0.0993 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1015 - val_loss: 0.0933 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0981 - val_loss: 0.0903 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0924 - val_loss: 0.0864 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0840 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.0802 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0755 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0658 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0672 - val_loss: 0.0574 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0573 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0542 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0548 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0506 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0561 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0514 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0552 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0528 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0502 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0509 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0568 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0583 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0573 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0568 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0572 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0555 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0558 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0551 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0547 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0543 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0548 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0545 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0546 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0546 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0546 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0546 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0546 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0545 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:48:43.383631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:43.384043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:43.384678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:43.436888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:43.437328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:43.437745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:43.520430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:43.520904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:43.521331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:43.580676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:43.581166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:43.581585: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:43.814187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:43.814641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:43.815157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:43.872730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:43.873214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:43.873630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 12ms/step - loss: 0.1339 - val_loss: 0.1138 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0694
2023-11-26 16:48:44.584744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:44.585227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:44.585896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:44.647669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:44.648106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:44.648493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.1101 - val_loss: 0.1309 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1064 - val_loss: 0.1273 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1001 - val_loss: 0.1173 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.0941 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0868 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0820 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0811 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0641 - val_loss: 0.0902 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0650 - val_loss: 0.0816 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0708 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0673 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0610 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0570 - val_loss: 0.0596 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0653 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0556 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0693 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0570 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0657 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0607 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0771 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0576 - val_loss: 0.0806 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0626 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0559 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.0501 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0482 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0474 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0463 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0457 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0453 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0452 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0450 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0450 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.0450 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0450 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0450 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0450 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0449 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0449 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0463 - val_loss: 0.0449 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0449 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0449 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0449 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0449 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0449 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0449 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0449 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0449 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0449 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0463 - val_loss: 0.0449 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0449 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.0449 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0449 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0449 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0449 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.0449 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0449 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0463 - val_loss: 0.0449 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0449 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0449 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 4.5872e-12
Epoch 1/100
2023-11-26 16:48:55.506802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:55.507260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:55.507681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:55.563786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:55.564181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:55.564530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:55.646113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:55.646584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:55.647007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:55.706406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:55.706852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:55.707256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:56.386940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:56.387450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:56.387894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:56.446439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:56.446846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:56.447259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 2s 11ms/step - loss: 0.1378 - val_loss: 0.1168 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0696
2023-11-26 16:48:57.186027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:57.186455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:57.186964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:48:57.247372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:48:57.247809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:48:57.248191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.1148 - val_loss: 0.1106 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1059 - val_loss: 0.1051 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0975 - val_loss: 0.1004 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0966 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0861 - val_loss: 0.0932 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0898 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0927 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0925 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0725 - val_loss: 0.0987 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.0834 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0874 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0791 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0637 - val_loss: 0.0833 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0664 - val_loss: 0.0768 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0777 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0748 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0753 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0701 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0697 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0682 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0666 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0660 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0655 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0648 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.0652 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0658 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0652 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0637 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0630 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0619 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0441 - val_loss: 0.0616 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0613 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0612 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0612 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0611 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0611 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0611 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0610 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0610 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0610 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0610 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0610 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0610 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0610 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.0610 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0610 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0610 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0423 - val_loss: 0.0610 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.0610 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0610 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0610 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0610 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0610 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0423 - val_loss: 0.0610 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0610 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0610 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0610 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0610 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.0610 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0610 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0610 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 2.8039e-15
Epoch 79/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0610 - lr: 1.3924e-15
Epoch 80/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0610 - lr: 6.9144e-16
Average Validation Loss: 0.062252051383256915
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:49:13.354544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:13.355120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:13.355579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:13.413497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:13.413902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:13.414284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:13.495414: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:13.495861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:13.496427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:13.557074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:13.557635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:13.558049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:13.792464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:13.792936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:13.793389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:13.851300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:13.851766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:13.852187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 66ms/step - loss: 0.1695 - val_loss: 0.1448 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1065
2023-11-26 16:49:14.433250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:14.433689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:14.434154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:14.494867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:14.495312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:14.495701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 10ms/step - loss: 0.1138 - val_loss: 0.1572 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1207 - val_loss: 0.1638 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1212 - val_loss: 0.1542 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1150 - val_loss: 0.1396 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1072 - val_loss: 0.1336 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0996 - val_loss: 0.1351 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0960 - val_loss: 0.1381 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0897 - val_loss: 0.1322 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0843 - val_loss: 0.1238 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0740 - val_loss: 0.1311 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0736 - val_loss: 0.1218 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0677 - val_loss: 0.1213 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0656 - val_loss: 0.1257 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0629 - val_loss: 0.1103 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0626 - val_loss: 0.1170 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0599 - val_loss: 0.1325 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0606 - val_loss: 0.1132 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0554 - val_loss: 0.1158 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0567 - val_loss: 0.1221 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0566 - val_loss: 0.1199 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0575 - val_loss: 0.1181 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0535 - val_loss: 0.1159 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0560 - val_loss: 0.1163 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0559 - val_loss: 0.1186 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0550 - val_loss: 0.1186 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0552 - val_loss: 0.1164 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0555 - val_loss: 0.1155 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0542 - val_loss: 0.1152 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0559 - val_loss: 0.1165 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0541 - val_loss: 0.1173 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0549 - val_loss: 0.1176 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 12ms/step - loss: 0.0558 - val_loss: 0.1176 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0543 - val_loss: 0.1174 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0532 - val_loss: 0.1172 - lr: 1.1109e-05
Epoch 1/100
2023-11-26 16:49:16.278238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:16.278726: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:16.279157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:16.336562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:16.336900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:16.337267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:16.419383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:16.419847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:16.420250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:16.480563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:16.481176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:16.481706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:16.713510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:16.713957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:16.714390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:16.772414: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:16.772897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:16.773316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 38ms/step - loss: 0.1695 - val_loss: 0.0975 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1331
2023-11-26 16:49:17.383735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:17.384254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:17.384881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:17.447229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:17.447658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:17.448031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 8ms/step - loss: 0.1407 - val_loss: 0.0952 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1314 - val_loss: 0.0993 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1235 - val_loss: 0.0880 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1158 - val_loss: 0.0801 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1095 - val_loss: 0.0834 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1020 - val_loss: 0.0749 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0972 - val_loss: 0.0696 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0907 - val_loss: 0.0655 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0839 - val_loss: 0.0679 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0781 - val_loss: 0.0710 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0763 - val_loss: 0.0636 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0727 - val_loss: 0.0613 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0712 - val_loss: 0.0588 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0679 - val_loss: 0.0636 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0659 - val_loss: 0.0622 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0650 - val_loss: 0.0603 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0633 - val_loss: 0.0599 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0632 - val_loss: 0.0597 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0608 - val_loss: 0.0602 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0600 - val_loss: 0.0593 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0594 - val_loss: 0.0597 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0587 - val_loss: 0.0605 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0589 - val_loss: 0.0615 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0584 - val_loss: 0.0601 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0574 - val_loss: 0.0610 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0561 - val_loss: 0.0600 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0581 - val_loss: 0.0593 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0574 - val_loss: 0.0600 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0562 - val_loss: 0.0593 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0564 - val_loss: 0.0593 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0576 - val_loss: 0.0600 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0562 - val_loss: 0.0600 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0563 - val_loss: 0.0601 - lr: 1.4996e-05
Epoch 1/100
2023-11-26 16:49:20.013174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:20.013583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:20.014160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:20.067387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:20.067778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:20.068113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:20.149828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:20.150307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:20.150728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:20.210124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:20.210589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:20.211153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:20.454534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:20.455012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:20.455554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:20.513558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:20.514022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:20.514425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 28ms/step - loss: 0.1312 - val_loss: 0.1258 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1371
2023-11-26 16:49:21.160792: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:21.161377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:21.162062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:21.227360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:21.227807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:21.228192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 8ms/step - loss: 0.1154 - val_loss: 0.1234 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1047 - val_loss: 0.1161 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1036 - val_loss: 0.1082 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0957 - val_loss: 0.1054 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0914 - val_loss: 0.0955 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0898 - val_loss: 0.0916 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0856 - val_loss: 0.0898 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0806 - val_loss: 0.0827 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0761 - val_loss: 0.0803 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0735 - val_loss: 0.0759 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0703 - val_loss: 0.0737 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0690 - val_loss: 0.0750 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0700 - val_loss: 0.0713 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0746 - val_loss: 0.0682 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0683 - val_loss: 0.0736 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0600 - val_loss: 0.0679 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0574 - val_loss: 0.0618 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0566 - val_loss: 0.0589 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0551 - val_loss: 0.0572 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0556 - val_loss: 0.0566 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0560 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0540 - val_loss: 0.0565 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0532 - val_loss: 0.0553 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0515 - val_loss: 0.0546 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0517 - val_loss: 0.0549 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0522 - val_loss: 0.0544 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0524 - val_loss: 0.0540 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0496 - val_loss: 0.0540 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0510 - val_loss: 0.0540 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0517 - val_loss: 0.0541 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0542 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0543 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0542 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0514 - val_loss: 0.0541 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0540 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0510 - val_loss: 0.0540 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0518 - val_loss: 0.0540 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0503 - val_loss: 0.0540 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0515 - val_loss: 0.0540 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0540 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0510 - val_loss: 0.0540 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0540 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0540 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0541 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0511 - val_loss: 0.0541 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0501 - val_loss: 0.0541 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0499 - val_loss: 0.0541 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0518 - val_loss: 0.0541 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0502 - val_loss: 0.0541 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0541 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0541 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0518 - val_loss: 0.0541 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0513 - val_loss: 0.0541 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0541 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0502 - val_loss: 0.0541 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0516 - val_loss: 0.0541 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0518 - val_loss: 0.0541 - lr: 3.0590e-10
Epoch 1/100
2023-11-26 16:49:27.340801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:27.341242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:27.341821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:27.393829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:27.394233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:27.394628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:27.484176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:27.485046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:27.485680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:27.555181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:27.555959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:27.556524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:27.795357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:27.795989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:27.796465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:27.854055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:27.854537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:27.854945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 21ms/step - loss: 0.1562 - val_loss: 0.1381 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1722
2023-11-26 16:49:28.517066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:28.517699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:28.518048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:28.579199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:28.579635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:28.580023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 8ms/step - loss: 0.1253 - val_loss: 0.1077 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1031 - val_loss: 0.1062 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0972 - val_loss: 0.1197 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0944 - val_loss: 0.1217 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0962 - val_loss: 0.1115 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0929 - val_loss: 0.0904 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0817 - val_loss: 0.1012 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0814 - val_loss: 0.1015 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0790 - val_loss: 0.1023 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0809 - val_loss: 0.1064 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0843 - val_loss: 0.0873 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0769 - val_loss: 0.0733 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0674 - val_loss: 0.0745 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0658 - val_loss: 0.0782 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0666 - val_loss: 0.0796 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0691 - val_loss: 0.0734 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0676 - val_loss: 0.0638 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0625 - val_loss: 0.0628 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0587 - val_loss: 0.0650 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0591 - val_loss: 0.0630 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0595 - val_loss: 0.0585 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0566 - val_loss: 0.0573 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0559 - val_loss: 0.0568 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0558 - val_loss: 0.0561 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0543 - val_loss: 0.0556 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0542 - val_loss: 0.0555 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0544 - val_loss: 0.0551 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0539 - val_loss: 0.0547 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0546 - val_loss: 0.0546 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0541 - val_loss: 0.0545 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0533 - val_loss: 0.0543 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0537 - val_loss: 0.0542 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0530 - val_loss: 0.0542 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0544 - val_loss: 0.0542 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0532 - val_loss: 0.0542 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0535 - val_loss: 0.0541 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0531 - val_loss: 0.0541 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0536 - val_loss: 0.0541 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0537 - val_loss: 0.0541 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0533 - val_loss: 0.0541 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0529 - val_loss: 0.0541 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0525 - val_loss: 0.0541 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0527 - val_loss: 0.0541 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0544 - val_loss: 0.0541 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0535 - val_loss: 0.0541 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0535 - val_loss: 0.0541 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0536 - val_loss: 0.0541 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0536 - val_loss: 0.0541 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0543 - val_loss: 0.0541 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0541 - val_loss: 0.0541 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0532 - val_loss: 0.0541 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0536 - val_loss: 0.0541 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0530 - val_loss: 0.0541 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0539 - val_loss: 0.0541 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0534 - val_loss: 0.0541 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0536 - val_loss: 0.0541 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0530 - val_loss: 0.0541 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0537 - val_loss: 0.0541 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0535 - val_loss: 0.0541 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0534 - val_loss: 0.0541 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0538 - val_loss: 0.0541 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0531 - val_loss: 0.0541 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0533 - val_loss: 0.0541 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0535 - val_loss: 0.0541 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0534 - val_loss: 0.0541 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0545 - val_loss: 0.0541 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0541 - val_loss: 0.0541 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0537 - val_loss: 0.0541 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0538 - val_loss: 0.0541 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0531 - val_loss: 0.0541 - lr: 3.7654e-13
Epoch 1/100
2023-11-26 16:49:37.876822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:37.877459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:37.877856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:37.936369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:37.936832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:37.937199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:38.029867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:38.030542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:38.031065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:38.099632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:38.100232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:38.100814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:38.363715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:38.364453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:38.365126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:38.430195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:38.430698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:38.431084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 20ms/step - loss: 0.1327 - val_loss: 0.1145 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1123
2023-11-26 16:49:39.187256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:39.187779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:39.188303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:39.259801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:39.260271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:39.260660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 8ms/step - loss: 0.1130 - val_loss: 0.1101 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1093 - val_loss: 0.1066 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1107 - val_loss: 0.1117 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1057 - val_loss: 0.1072 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0974 - val_loss: 0.1013 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0925 - val_loss: 0.0993 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0940 - val_loss: 0.1034 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0956 - val_loss: 0.1062 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0910 - val_loss: 0.1010 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0853 - val_loss: 0.0972 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0796 - val_loss: 0.0962 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0776 - val_loss: 0.0926 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0725 - val_loss: 0.0921 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0740 - val_loss: 0.0960 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0736 - val_loss: 0.0941 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0714 - val_loss: 0.0919 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0679 - val_loss: 0.0884 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0636 - val_loss: 0.0857 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0610 - val_loss: 0.0843 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0604 - val_loss: 0.0813 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0570 - val_loss: 0.0783 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0557 - val_loss: 0.0773 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0558 - val_loss: 0.0754 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0544 - val_loss: 0.0742 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0531 - val_loss: 0.0739 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0524 - val_loss: 0.0728 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0520 - val_loss: 0.0726 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0518 - val_loss: 0.0721 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0510 - val_loss: 0.0719 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0513 - val_loss: 0.0718 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0511 - val_loss: 0.0716 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0516 - val_loss: 0.0715 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0714 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0517 - val_loss: 0.0713 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0713 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0513 - val_loss: 0.0713 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0510 - val_loss: 0.0713 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0509 - val_loss: 0.0713 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0713 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0713 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0713 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0511 - val_loss: 0.0713 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0506 - val_loss: 0.0712 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0503 - val_loss: 0.0712 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0712 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0712 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0712 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0712 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0504 - val_loss: 0.0712 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0712 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0712 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0712 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0514 - val_loss: 0.0712 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0511 - val_loss: 0.0712 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0712 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0712 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0712 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0712 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0712 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0712 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0712 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0712 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0511 - val_loss: 0.0712 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0712 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0712 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0515 - val_loss: 0.0712 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0506 - val_loss: 0.0712 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0712 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0519 - val_loss: 0.0712 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0511 - val_loss: 0.0712 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0712 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0514 - val_loss: 0.0712 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0503 - val_loss: 0.0712 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0712 - lr: 2.2897e-14
Average Validation Loss: 0.0696734644472599
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:49:51.996248: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:51.997355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:51.997805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:52.056771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:52.057542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:52.057999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:52.149671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:52.150257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:52.150848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:52.698712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:52.700030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:52.700648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:52.963858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:52.964408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:52.965233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:53.032195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:53.032705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:53.033161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 2s 19ms/step - loss: 0.1117 - val_loss: 0.1634 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1357
2023-11-26 16:49:53.668338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:53.668811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:53.669340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:53.731504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:53.731946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:53.732317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.1234 - val_loss: 0.1163 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.1323 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1022 - val_loss: 0.1131 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.1454 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1014 - val_loss: 0.1029 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.1090 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.1181 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.1261 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.1221 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.1097 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0938 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0842 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0880 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0930 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0980 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.1042 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.1059 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.0929 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0418 - val_loss: 0.0834 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0378 - val_loss: 0.0910 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0898 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0379 - val_loss: 0.0899 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0372 - val_loss: 0.0877 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0360 - val_loss: 0.0897 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0368 - val_loss: 0.0922 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0365 - val_loss: 0.0854 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0353 - val_loss: 0.0905 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0347 - val_loss: 0.0881 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0352 - val_loss: 0.0863 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0871 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0353 - val_loss: 0.0847 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0348 - val_loss: 0.0860 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0346 - val_loss: 0.0865 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0345 - val_loss: 0.0870 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0360 - val_loss: 0.0872 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0335 - val_loss: 0.0870 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0870 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0359 - val_loss: 0.0871 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0360 - val_loss: 0.0873 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:49:57.192131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:57.192937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:57.193395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:57.251245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:57.251618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:57.251962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:57.331124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:57.331621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:57.332040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:57.391792: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:57.392259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:57.392720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:57.571937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:57.572418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:57.572855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:57.629227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:57.629686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:57.630125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1340 - val_loss: 0.0812 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0520
2023-11-26 16:49:58.136151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:58.136627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:58.137274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:49:58.197851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:49:58.198299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:49:58.198696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1251 - val_loss: 0.0762 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1155 - val_loss: 0.0760 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1162 - val_loss: 0.0688 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1130 - val_loss: 0.0743 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1105 - val_loss: 0.0680 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1064 - val_loss: 0.0763 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1062 - val_loss: 0.0593 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0994 - val_loss: 0.0852 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0957 - val_loss: 0.0638 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0941 - val_loss: 0.0888 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0824 - val_loss: 0.0848 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0827 - val_loss: 0.0675 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0787 - val_loss: 0.0774 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0738 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0704 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0608 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0661 - val_loss: 0.0537 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0542 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0581 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0600 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0578 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0640 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0631 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0659 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0652 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0649 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0637 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0629 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0658 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0658 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0657 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0661 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0658 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0428 - val_loss: 0.0663 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0668 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0664 - lr: 4.5166e-06
Epoch 1/100
2023-11-26 16:50:02.396848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:02.397298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:02.397823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:02.454921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:02.455315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:02.455735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:02.537513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:02.538003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:02.538416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:02.601193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:02.601863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:02.602385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:02.837062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:02.837512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:02.838191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:02.896682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:02.897137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:02.897562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.1224 - val_loss: 0.1041 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0964
2023-11-26 16:50:03.643044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:03.643601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:03.644083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:03.707539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:03.707964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:03.708375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1094 - val_loss: 0.0978 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1057 - val_loss: 0.0935 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1011 - val_loss: 0.0889 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0986 - val_loss: 0.0863 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0969 - val_loss: 0.0876 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0932 - val_loss: 0.0852 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0946 - val_loss: 0.0888 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0895 - val_loss: 0.0814 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0880 - val_loss: 0.0867 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0833 - val_loss: 0.0747 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0815 - val_loss: 0.0742 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0712 - val_loss: 0.0607 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0657 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0569 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0583 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0520 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0526 - val_loss: 0.0545 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0537 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0539 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0515 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0509 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0520 - val_loss: 0.0478 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0504 - val_loss: 0.0467 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0469 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0481 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0487 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0485 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0492 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0487 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0489 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0488 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0485 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0490 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0491 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0489 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0489 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0489 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0489 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0489 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0489 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0489 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0489 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0489 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:50:11.861737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:11.862165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:11.862754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:11.917242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:11.917563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:11.917917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:12.005085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:12.005938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:12.006532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:12.071814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:12.072523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:12.073000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:12.305139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:12.305594: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:12.306028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:12.364588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:12.365043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:12.365411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1194 - val_loss: 0.1220 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1217
2023-11-26 16:50:13.148429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:13.149017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:13.149413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:13.210456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:13.210901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:13.211277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1098 - val_loss: 0.1189 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.1072 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0996 - val_loss: 0.1023 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0947 - val_loss: 0.0957 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0903 - val_loss: 0.0941 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0849 - val_loss: 0.0945 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0881 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.1032 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0697 - val_loss: 0.1013 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.0996 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0944 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0823 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0777 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0760 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0691 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0670 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0647 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0678 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0657 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0642 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0642 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0654 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0650 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0645 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0609 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0566 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0546 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0525 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0504 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0450 - val_loss: 0.0495 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0445 - val_loss: 0.0489 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0485 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0484 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0483 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0482 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0481 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0481 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0425 - val_loss: 0.0481 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0480 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0480 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0480 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0480 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0425 - val_loss: 0.0480 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0480 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0480 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0480 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0480 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0480 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0480 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0480 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0480 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0480 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0480 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0480 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0480 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0480 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0480 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0480 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0480 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0480 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0480 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0480 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0423 - val_loss: 0.0480 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0480 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0480 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0480 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0480 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0480 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0480 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0480 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0480 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0480 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0480 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0480 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0480 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0423 - val_loss: 0.0480 - lr: 5.6464e-15
Epoch 1/100
2023-11-26 16:50:31.819823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:31.820245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:31.820843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:31.874215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:31.874669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:31.875144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:31.965482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:31.965988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:31.966422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:32.030828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:32.031536: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:32.032004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:32.288376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:32.289084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:32.289638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:32.349798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:32.350274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:32.350701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 7ms/step - loss: 0.1157 - val_loss: 0.0994 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0387
2023-11-26 16:50:33.204022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:33.204614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:33.205082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:33.267526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:33.267980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:33.268376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 4ms/step - loss: 0.1019 - val_loss: 0.0947 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0972 - val_loss: 0.0933 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0924 - val_loss: 0.0912 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0883 - val_loss: 0.0889 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0853 - val_loss: 0.0878 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0816 - val_loss: 0.0853 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0765 - val_loss: 0.0818 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.0815 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0740 - val_loss: 0.0797 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0718 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0710 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0681 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0655 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0637 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0610 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0605 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0587 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0572 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0560 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0419 - val_loss: 0.0531 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0408 - val_loss: 0.0515 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0485 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0469 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0359 - val_loss: 0.0468 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0454 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0347 - val_loss: 0.0448 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0340 - val_loss: 0.0440 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0337 - val_loss: 0.0433 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0332 - val_loss: 0.0435 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0332 - val_loss: 0.0425 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0335 - val_loss: 0.0421 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0326 - val_loss: 0.0418 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0330 - val_loss: 0.0417 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0319 - val_loss: 0.0416 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0325 - val_loss: 0.0416 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0326 - val_loss: 0.0416 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0324 - val_loss: 0.0415 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0325 - val_loss: 0.0415 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0320 - val_loss: 0.0415 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0330 - val_loss: 0.0416 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0326 - val_loss: 0.0416 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0322 - val_loss: 0.0416 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0317 - val_loss: 0.0416 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0320 - val_loss: 0.0416 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0323 - val_loss: 0.0416 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0319 - val_loss: 0.0416 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0323 - val_loss: 0.0416 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0321 - val_loss: 0.0416 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0321 - val_loss: 0.0416 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0323 - val_loss: 0.0416 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0319 - val_loss: 0.0416 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0319 - val_loss: 0.0416 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0319 - val_loss: 0.0416 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0318 - val_loss: 0.0416 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0316 - val_loss: 0.0416 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0323 - val_loss: 0.0416 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0324 - val_loss: 0.0416 - lr: 8.3153e-10
Average Validation Loss: 0.054644621163606646
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 16:50:50.422911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:50.423463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:50.423992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:50.478700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:50.479107: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:50.479462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:50.559827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:50.560319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:50.560705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:50.620983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:50.621438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:50.621838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:50.866788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:50.867503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:50.868174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:50.926857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:50.927332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:50.927752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 36ms/step - loss: 0.1095 - val_loss: 0.1623 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1116
2023-11-26 16:50:51.510443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:51.510938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:51.511581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:51.572003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:51.572517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:51.572922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 7ms/step - loss: 0.1233 - val_loss: 0.1532 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1150 - val_loss: 0.1215 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1002 - val_loss: 0.1171 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0890 - val_loss: 0.1249 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0901 - val_loss: 0.1230 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0864 - val_loss: 0.1156 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0754 - val_loss: 0.1213 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0765 - val_loss: 0.1064 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0623 - val_loss: 0.1169 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0618 - val_loss: 0.0978 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0524 - val_loss: 0.1159 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0515 - val_loss: 0.1164 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0519 - val_loss: 0.1018 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0447 - val_loss: 0.1097 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0454 - val_loss: 0.1101 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0455 - val_loss: 0.1048 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0443 - val_loss: 0.1066 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0452 - val_loss: 0.1069 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0438 - val_loss: 0.1049 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0429 - val_loss: 0.1044 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0422 - val_loss: 0.1108 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0436 - val_loss: 0.1025 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0426 - val_loss: 0.1025 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0421 - val_loss: 0.1107 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0421 - val_loss: 0.1100 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0422 - val_loss: 0.1030 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0431 - val_loss: 0.1003 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0415 - val_loss: 0.1029 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0412 - val_loss: 0.1058 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0408 - val_loss: 0.1066 - lr: 3.6883e-05
2023-11-26 16:50:53.440913: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:53.441370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:53.441725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:53.497766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:53.498104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:53.498510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
Epoch 1/100
2023-11-26 16:50:53.996204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:53.996790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:53.997415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:54.058053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:54.058539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:54.058944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:54.242983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:54.243434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:54.244111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:54.302090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:54.302543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:54.302947: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.1377 - val_loss: 0.0794 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0830
2023-11-26 16:50:54.774968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:54.775503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:54.775916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:54.835855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:54.836329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:54.836842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1217 - val_loss: 0.0918 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1105 - val_loss: 0.0691 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1034 - val_loss: 0.0757 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0986 - val_loss: 0.0643 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0948 - val_loss: 0.0704 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0629 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0860 - val_loss: 0.0661 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.0640 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0654 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0640 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0683 - val_loss: 0.0638 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0645 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0568 - val_loss: 0.0630 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0617 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0577 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0572 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0654 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0645 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0658 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0629 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0609 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0629 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0626 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0450 - val_loss: 0.0646 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0633 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0439 - val_loss: 0.0646 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0439 - val_loss: 0.0623 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0440 - val_loss: 0.0650 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0636 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0635 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0630 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0631 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0637 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0639 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0639 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0640 - lr: 6.0967e-06
Epoch 1/100
2023-11-26 16:50:57.834088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:57.834666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:57.835134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:57.891127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:57.891508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:57.892005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:57.974395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:57.974874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:57.975292: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:58.036578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:58.037162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:58.037609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:58.275438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:58.275897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:58.276336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:58.335158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:58.335620: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:58.336074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 15ms/step - loss: 0.1211 - val_loss: 0.1163 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0512
2023-11-26 16:50:58.997455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:58.997919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:58.998596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:50:59.059029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:50:59.059477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:50:59.059866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.1042 - val_loss: 0.1000 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0985 - val_loss: 0.0915 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.0871 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0911 - val_loss: 0.0830 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0824 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.0815 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.0786 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0731 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0721 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0692 - val_loss: 0.0638 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0617 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0638 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0670 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.0694 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0664 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0582 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0588 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0556 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0556 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0529 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0510 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0536 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0538 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0537 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0526 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0532 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0515 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0529 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0444 - val_loss: 0.0527 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0524 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0526 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0440 - val_loss: 0.0527 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0525 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0523 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0440 - val_loss: 0.0523 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.0523 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0524 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0524 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.0523 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0436 - val_loss: 0.0523 - lr: 1.1138e-06
Epoch 1/100
2023-11-26 16:51:04.545820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:04.546473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:04.546877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:04.599855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:04.600239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:04.600594: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:04.692347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:04.692806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:04.693195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:04.758587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:04.759462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:04.759968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:05.002523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:05.002992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:05.003428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:05.062179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:05.062577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:05.062996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 12ms/step - loss: 0.1206 - val_loss: 0.0967 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0548
2023-11-26 16:51:05.763483: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:05.763950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:05.764656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:05.825556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:05.825997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:05.826394: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.0948 - val_loss: 0.1125 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.0852 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0793 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0734 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.1001 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0916 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0601 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0611 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0668 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0543 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0608 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0613 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0632 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0616 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0623 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0647 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0666 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0731 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0760 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0820 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0647 - val_loss: 0.0542 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0464 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0425 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0401 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0386 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0371 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0375 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0371 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0450 - val_loss: 0.0369 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0446 - val_loss: 0.0367 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0441 - val_loss: 0.0366 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0365 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0434 - val_loss: 0.0365 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0365 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0365 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0365 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0365 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0436 - val_loss: 0.0365 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0365 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0365 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0365 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0365 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0365 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0365 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0365 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0365 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0365 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0365 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0434 - val_loss: 0.0365 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0436 - val_loss: 0.0365 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0365 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0365 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0365 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0365 - lr: 3.7267e-09
Epoch 1/100
2023-11-26 16:51:14.888109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:14.888683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:14.889030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:14.943509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:14.943903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:14.944299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:15.026005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:15.026500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:15.026915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:15.087338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:15.087818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:15.088236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:15.325291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:15.325742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:15.326216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:15.387445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:15.387948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:15.388386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 11ms/step - loss: 0.1144 - val_loss: 0.1070 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0553
2023-11-26 16:51:16.117868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:16.118401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:16.118899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:16.183653: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:16.184102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:16.184483: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.0955 - val_loss: 0.1040 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.1027 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.0999 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.0982 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0966 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0946 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0933 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0902 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0900 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0654 - val_loss: 0.0883 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0643 - val_loss: 0.0873 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0870 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0850 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0838 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0827 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0819 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0807 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0794 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0786 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0775 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0442 - val_loss: 0.0772 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0440 - val_loss: 0.0765 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0758 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0756 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0756 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0743 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0729 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0722 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0715 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0709 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0704 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0702 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0700 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0699 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0698 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0697 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0697 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0697 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0696 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0696 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0696 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0696 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0696 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0696 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0696 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0696 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0696 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0696 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0696 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0696 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0696 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0696 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0696 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0696 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0696 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0696 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0696 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0696 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0696 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0696 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0696 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0696 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0696 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.0696 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0696 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0696 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0696 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0696 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0696 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0696 - lr: 2.8039e-15
Epoch 79/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0696 - lr: 1.3924e-15
Average Validation Loss: 0.06242407336831093
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 16:51:32.130855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:32.131290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:32.131901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:32.189465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:32.189840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:32.190194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:32.277160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:32.277835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:32.278575: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:32.341408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:32.342100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:32.342585: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:32.585537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:32.586000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:32.586457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:32.644767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:32.645223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:32.645650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 68ms/step - loss: 0.1455 - val_loss: 0.1309 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0881
2023-11-26 16:51:33.214103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:33.214587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:33.215277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:33.276443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:33.276896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:33.277285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 10ms/step - loss: 0.1031 - val_loss: 0.1435 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1108 - val_loss: 0.1475 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1065 - val_loss: 0.1381 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1055 - val_loss: 0.1268 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0987 - val_loss: 0.1197 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0946 - val_loss: 0.1175 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0896 - val_loss: 0.1169 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0861 - val_loss: 0.1174 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0817 - val_loss: 0.1175 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0771 - val_loss: 0.1134 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0724 - val_loss: 0.1112 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0631 - val_loss: 0.1105 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0611 - val_loss: 0.1031 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0566 - val_loss: 0.1097 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0563 - val_loss: 0.1077 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0517 - val_loss: 0.1069 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0509 - val_loss: 0.1072 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0497 - val_loss: 0.1035 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0495 - val_loss: 0.1088 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0484 - val_loss: 0.1071 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0470 - val_loss: 0.1054 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0454 - val_loss: 0.1070 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0447 - val_loss: 0.1082 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0490 - val_loss: 0.1077 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0469 - val_loss: 0.1065 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0461 - val_loss: 0.1061 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0465 - val_loss: 0.1067 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0458 - val_loss: 0.1066 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0459 - val_loss: 0.1057 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0448 - val_loss: 0.1051 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0449 - val_loss: 0.1055 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0442 - val_loss: 0.1058 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0441 - val_loss: 0.1061 - lr: 1.4996e-05
Epoch 1/100
2023-11-26 16:51:35.000396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:35.000786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:35.001213: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:35.057197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:35.057554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:35.057912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:35.141125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:35.141577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:35.141996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:35.202797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:35.203492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:35.203940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:35.443355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:35.443825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:35.444403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:35.504475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:35.504933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:35.505370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 39ms/step - loss: 0.1424 - val_loss: 0.0865 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1368
2023-11-26 16:51:36.103281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:36.103878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:36.104498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:36.167334: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:36.167803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:36.168188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 8ms/step - loss: 0.1209 - val_loss: 0.0788 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1085 - val_loss: 0.0898 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1030 - val_loss: 0.0694 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0940 - val_loss: 0.0758 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0890 - val_loss: 0.0720 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0808 - val_loss: 0.0756 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0776 - val_loss: 0.0662 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0738 - val_loss: 0.0673 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0679 - val_loss: 0.0711 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0635 - val_loss: 0.0789 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0615 - val_loss: 0.0687 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0598 - val_loss: 0.0643 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0603 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0532 - val_loss: 0.0594 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0518 - val_loss: 0.0589 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0494 - val_loss: 0.0558 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0497 - val_loss: 0.0565 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0501 - val_loss: 0.0555 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0474 - val_loss: 0.0561 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0470 - val_loss: 0.0552 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0576 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0543 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0455 - val_loss: 0.0561 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0537 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0465 - val_loss: 0.0551 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0555 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0453 - val_loss: 0.0544 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0545 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0448 - val_loss: 0.0547 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0444 - val_loss: 0.0544 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0445 - val_loss: 0.0546 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0445 - val_loss: 0.0548 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0456 - val_loss: 0.0550 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0448 - val_loss: 0.0552 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0456 - val_loss: 0.0553 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0448 - val_loss: 0.0551 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0550 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0441 - val_loss: 0.0549 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0442 - val_loss: 0.0549 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0549 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0442 - val_loss: 0.0549 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0438 - val_loss: 0.0549 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0458 - val_loss: 0.0550 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0451 - val_loss: 0.0550 - lr: 3.3546e-07
Epoch 1/100
2023-11-26 16:51:39.958833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:39.959220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:39.959567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:40.015012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:40.015350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:40.015698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:40.098093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:40.098580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:40.098989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:40.158177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:40.158629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:40.159048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:40.403218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:40.403705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:40.404167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:40.465205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:40.465692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:40.466121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 27ms/step - loss: 0.1166 - val_loss: 0.1090 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1299
2023-11-26 16:51:41.085366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:41.085845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:41.086553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:41.150963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:41.151407: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:41.151805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 8ms/step - loss: 0.1050 - val_loss: 0.1109 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0933 - val_loss: 0.0885 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0929 - val_loss: 0.0751 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0871 - val_loss: 0.0702 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0844 - val_loss: 0.0667 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0816 - val_loss: 0.0645 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0809 - val_loss: 0.0624 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0776 - val_loss: 0.0576 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0749 - val_loss: 0.0548 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0714 - val_loss: 0.0534 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0698 - val_loss: 0.0519 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0639 - val_loss: 0.0502 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0591 - val_loss: 0.0488 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0634 - val_loss: 0.0486 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0608 - val_loss: 0.0524 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0537 - val_loss: 0.0497 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0439 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0500 - val_loss: 0.0431 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0534 - val_loss: 0.0457 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0525 - val_loss: 0.0561 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0490 - val_loss: 0.0513 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0472 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0458 - val_loss: 0.0495 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0454 - val_loss: 0.0475 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0451 - val_loss: 0.0462 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0456 - val_loss: 0.0500 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0453 - val_loss: 0.0472 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0452 - val_loss: 0.0486 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0440 - val_loss: 0.0477 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0439 - val_loss: 0.0474 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0448 - val_loss: 0.0486 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0438 - val_loss: 0.0482 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0447 - val_loss: 0.0478 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0434 - val_loss: 0.0480 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0452 - val_loss: 0.0480 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0445 - val_loss: 0.0481 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0447 - val_loss: 0.0481 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0440 - val_loss: 0.0482 - lr: 3.3460e-06
Epoch 1/100
2023-11-26 16:51:45.082085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:45.082497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:45.083114: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:45.133803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:45.134226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:45.134599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:45.220377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:45.220862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:45.221282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:45.281247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:45.281711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:45.282129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:45.521571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:45.522238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:45.522734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:45.581460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:45.581924: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:45.582349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 21ms/step - loss: 0.1315 - val_loss: 0.1123 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1401
2023-11-26 16:51:46.225406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:46.225828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:46.226228: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:46.286079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:46.286503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:46.286887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 7ms/step - loss: 0.1137 - val_loss: 0.0999 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0987 - val_loss: 0.0963 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0909 - val_loss: 0.1110 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0922 - val_loss: 0.1211 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0938 - val_loss: 0.0943 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0844 - val_loss: 0.0841 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.1177 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0790 - val_loss: 0.1250 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0856 - val_loss: 0.0851 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0760 - val_loss: 0.0668 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0652 - val_loss: 0.0629 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0596 - val_loss: 0.0704 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0570 - val_loss: 0.0659 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0552 - val_loss: 0.0620 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0528 - val_loss: 0.0688 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0552 - val_loss: 0.0820 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0654 - val_loss: 0.0802 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0708 - val_loss: 0.0485 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0515 - val_loss: 0.0504 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0525 - val_loss: 0.0487 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0531 - val_loss: 0.0438 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0503 - val_loss: 0.0434 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0488 - val_loss: 0.0422 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0479 - val_loss: 0.0424 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0475 - val_loss: 0.0413 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0467 - val_loss: 0.0413 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0467 - val_loss: 0.0408 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0468 - val_loss: 0.0406 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0474 - val_loss: 0.0407 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0462 - val_loss: 0.0404 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0456 - val_loss: 0.0404 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0405 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0404 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0458 - val_loss: 0.0405 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0405 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0405 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0405 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0454 - val_loss: 0.0405 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0404 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0467 - val_loss: 0.0404 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0404 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0462 - val_loss: 0.0404 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0457 - val_loss: 0.0404 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0404 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0466 - val_loss: 0.0404 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0404 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0458 - val_loss: 0.0404 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0452 - val_loss: 0.0404 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0404 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0404 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0457 - val_loss: 0.0404 - lr: 1.6702e-08
Epoch 1/100
2023-11-26 16:51:52.823952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:52.824782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:52.825367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:52.882150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:52.882554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:52.882875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:52.977280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:52.977749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:52.978160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:53.042001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:53.042571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:53.043016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:53.285339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:53.285817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:53.286404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:53.346755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:53.347264: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:53.347677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 18ms/step - loss: 0.1227 - val_loss: 0.1040 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1033
2023-11-26 16:51:54.017176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:54.017681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:54.018344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:51:54.080826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:51:54.081277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:51:54.081657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 7ms/step - loss: 0.1024 - val_loss: 0.1029 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1008 - val_loss: 0.1043 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0975 - val_loss: 0.1033 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0929 - val_loss: 0.0980 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0901 - val_loss: 0.0996 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0910 - val_loss: 0.0994 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0874 - val_loss: 0.0960 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0838 - val_loss: 0.0942 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0810 - val_loss: 0.0913 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0716 - val_loss: 0.0828 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0670 - val_loss: 0.0816 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0640 - val_loss: 0.0780 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0630 - val_loss: 0.0820 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0629 - val_loss: 0.0865 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0670 - val_loss: 0.0897 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0681 - val_loss: 0.0855 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0622 - val_loss: 0.0786 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0566 - val_loss: 0.0756 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0529 - val_loss: 0.0738 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0521 - val_loss: 0.0722 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0514 - val_loss: 0.0683 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0504 - val_loss: 0.0649 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0476 - val_loss: 0.0632 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0626 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0623 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0609 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0448 - val_loss: 0.0606 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0456 - val_loss: 0.0603 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0446 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0446 - val_loss: 0.0600 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0444 - val_loss: 0.0596 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0442 - val_loss: 0.0598 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0441 - val_loss: 0.0594 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0445 - val_loss: 0.0592 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0447 - val_loss: 0.0592 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0444 - val_loss: 0.0592 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0441 - val_loss: 0.0592 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0440 - val_loss: 0.0592 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0451 - val_loss: 0.0592 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0440 - val_loss: 0.0592 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0440 - val_loss: 0.0591 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0440 - val_loss: 0.0591 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0439 - val_loss: 0.0591 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0444 - val_loss: 0.0591 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0447 - val_loss: 0.0591 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0443 - val_loss: 0.0591 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0446 - val_loss: 0.0591 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0441 - val_loss: 0.0591 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0440 - val_loss: 0.0591 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0444 - val_loss: 0.0591 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0435 - val_loss: 0.0591 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0447 - val_loss: 0.0591 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0438 - val_loss: 0.0591 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0444 - val_loss: 0.0591 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0446 - val_loss: 0.0591 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0445 - val_loss: 0.0591 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0440 - val_loss: 0.0591 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0441 - val_loss: 0.0591 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0443 - val_loss: 0.0591 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0439 - val_loss: 0.0591 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0442 - val_loss: 0.0591 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0442 - val_loss: 0.0591 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0447 - val_loss: 0.0591 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0442 - val_loss: 0.0591 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0436 - val_loss: 0.0591 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0452 - val_loss: 0.0591 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0443 - val_loss: 0.0591 - lr: 2.5175e-12
Average Validation Loss: 0.05988508611917496
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:52:04.431262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:04.431822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:04.432118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:04.485955: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:04.486352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:04.486700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:04.573361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:04.573857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:04.574274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:04.635683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:04.636255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:04.636821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:04.874437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:04.874913: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:04.875358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:04.932992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:04.933449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:04.933863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.2300 - val_loss: 0.2670 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.2492
2023-11-26 16:52:05.546596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:05.547065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:05.547485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:05.609395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:05.609846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:05.610199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.2332 - val_loss: 0.2272 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.2079 - val_loss: 0.2116 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1878 - val_loss: 0.2003 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1741 - val_loss: 0.1921 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1528 - val_loss: 0.2193 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1726 - val_loss: 0.1688 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1305 - val_loss: 0.1572 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1164 - val_loss: 0.1503 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1125 - val_loss: 0.1423 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1074 - val_loss: 0.1484 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1054 - val_loss: 0.1545 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1045 - val_loss: 0.1587 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1027 - val_loss: 0.1506 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0981 - val_loss: 0.1271 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.1273 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0925 - val_loss: 0.1495 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0980 - val_loss: 0.1315 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.1273 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0849 - val_loss: 0.1308 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.1280 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1242 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.1243 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.1274 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.1236 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.1222 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1263 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.1227 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.1222 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.1238 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.1235 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.1227 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.1231 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.1230 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.1221 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1219 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.1220 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1221 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.1222 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1219 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1218 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.1218 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.1218 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1217 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.1217 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.1217 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.1217 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.1217 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1217 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.1217 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.1217 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.1217 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.1217 - lr: 1.0130e-08
Epoch 54/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.1217 - lr: 6.1442e-09
Epoch 55/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.1217 - lr: 3.7267e-09
Epoch 56/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1217 - lr: 2.2603e-09
Epoch 57/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.1217 - lr: 1.3710e-09
Epoch 58/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.1217 - lr: 8.3153e-10
Epoch 59/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1217 - lr: 5.0435e-10
Epoch 60/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.1217 - lr: 3.0590e-10
Epoch 61/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0790 - val_loss: 0.1217 - lr: 1.6788e-10
Epoch 62/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.1217 - lr: 9.2136e-11
Epoch 63/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.1217 - lr: 5.0565e-11
Epoch 64/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.1217 - lr: 2.7751e-11
Epoch 65/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.1217 - lr: 1.5230e-11
Epoch 66/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.1217 - lr: 8.3584e-12
Epoch 67/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.1217 - lr: 4.5872e-12
Epoch 1/100
2023-11-26 16:52:11.340470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:11.340904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:11.341533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:11.399203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:11.399590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:11.399973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:11.481854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:11.482470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:11.482860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:11.543484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:11.544079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:11.544520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:11.727782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:11.728278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:11.728696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:11.788181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:11.788636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:11.789063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.2548 - val_loss: 0.1794 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1807
2023-11-26 16:52:12.292301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:12.292900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:12.293305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:12.356997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:12.357450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:12.357844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.2221 - val_loss: 0.1701 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.2003 - val_loss: 0.1465 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1839 - val_loss: 0.1398 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1719 - val_loss: 0.1185 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1618 - val_loss: 0.1328 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1576 - val_loss: 0.1045 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1506 - val_loss: 0.1325 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1418 - val_loss: 0.0950 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1382 - val_loss: 0.1327 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1301 - val_loss: 0.0884 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1311 - val_loss: 0.1242 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1202 - val_loss: 0.0883 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1151 - val_loss: 0.1163 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1106 - val_loss: 0.0922 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1052 - val_loss: 0.1079 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1014 - val_loss: 0.0963 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0981 - val_loss: 0.0936 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0940 - val_loss: 0.0897 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0900 - val_loss: 0.0876 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0868 - val_loss: 0.0802 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0823 - val_loss: 0.0805 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0814 - val_loss: 0.0754 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0770 - val_loss: 0.0809 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0809 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.0807 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0730 - val_loss: 0.0822 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0810 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0709 - val_loss: 0.0830 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0826 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0716 - val_loss: 0.0821 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0827 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0834 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0823 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0829 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0834 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0834 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0691 - val_loss: 0.0834 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0833 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0833 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0834 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0834 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0834 - lr: 7.4659e-07
Epoch 1/100
2023-11-26 16:52:17.052257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:17.052723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:17.053239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:17.109706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:17.110089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:17.110443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:17.192689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:17.193178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:17.193597: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:17.254974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:17.255641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:17.256069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:17.495248: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:17.495705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:17.496329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:17.554006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:17.554478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:17.554922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 2s 17ms/step - loss: 0.2348 - val_loss: 0.2049 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.2006
2023-11-26 16:52:18.686834: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:18.687294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:18.687900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:18.750016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:18.750463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:18.750854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1972 - val_loss: 0.1775 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1736 - val_loss: 0.1577 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1579 - val_loss: 0.1449 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1479 - val_loss: 0.1341 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1396 - val_loss: 0.1297 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1348 - val_loss: 0.1277 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1276 - val_loss: 0.1165 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1227 - val_loss: 0.1166 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1173 - val_loss: 0.1113 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1160 - val_loss: 0.1136 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1147 - val_loss: 0.1066 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1030 - val_loss: 0.1048 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1019 - val_loss: 0.0998 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0953 - val_loss: 0.0908 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0913 - val_loss: 0.0899 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0859 - val_loss: 0.0810 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0818 - val_loss: 0.0813 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0788 - val_loss: 0.0774 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0758 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0726 - val_loss: 0.0746 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0718 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0722 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0687 - val_loss: 0.0725 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0702 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0681 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0676 - val_loss: 0.0665 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0650 - val_loss: 0.0653 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0631 - val_loss: 0.0647 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0640 - val_loss: 0.0643 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0643 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0641 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0639 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0639 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0638 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0637 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0637 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0637 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0637 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0637 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0637 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0637 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0637 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0637 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0637 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0637 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0637 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0637 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0637 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0637 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0637 - lr: 1.6702e-08
Epoch 53/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0637 - lr: 1.0130e-08
Epoch 54/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0620 - val_loss: 0.0637 - lr: 6.1442e-09
Epoch 55/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0637 - lr: 3.7267e-09
Epoch 56/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0637 - lr: 2.2603e-09
Epoch 57/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0637 - lr: 1.3710e-09
Epoch 58/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0637 - lr: 8.3153e-10
Epoch 59/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0637 - lr: 5.0435e-10
Epoch 60/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0637 - lr: 3.0590e-10
Epoch 61/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0637 - lr: 1.6788e-10
Epoch 62/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0637 - lr: 9.2136e-11
Epoch 63/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0637 - lr: 5.0565e-11
Epoch 64/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0637 - lr: 2.7751e-11
Epoch 65/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0620 - val_loss: 0.0637 - lr: 1.5230e-11
Epoch 66/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0637 - lr: 8.3584e-12
Epoch 67/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0637 - lr: 4.5872e-12
Epoch 68/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0637 - lr: 2.5175e-12
Epoch 69/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0637 - lr: 1.3816e-12
Epoch 70/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0637 - lr: 7.5826e-13
Epoch 71/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0637 - lr: 3.7654e-13
Epoch 72/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0637 - lr: 1.8698e-13
Epoch 73/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0637 - lr: 9.2853e-14
Epoch 74/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0637 - lr: 4.6110e-14
Epoch 75/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0637 - lr: 2.2897e-14
Epoch 76/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0637 - lr: 1.1370e-14
Epoch 1/100
2023-11-26 16:52:33.236234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:33.236846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:33.237209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:33.292354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:33.292863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:33.293266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:33.379520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:33.380029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:33.380446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:33.444229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:33.444779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:33.445288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:33.685417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:33.685877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:33.686517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:33.744566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:33.745021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:33.745435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 8ms/step - loss: 0.2265 - val_loss: 0.2268 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.2299
2023-11-26 16:52:34.537505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:34.537986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:34.538396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:34.600310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:34.600780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:34.601185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1864 - val_loss: 0.1794 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1619 - val_loss: 0.1749 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1478 - val_loss: 0.1525 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1394 - val_loss: 0.1366 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1298 - val_loss: 0.1285 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1243 - val_loss: 0.1303 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1180 - val_loss: 0.1244 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1142 - val_loss: 0.1144 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1074 - val_loss: 0.1102 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0999 - val_loss: 0.1010 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0929 - val_loss: 0.0992 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0863 - val_loss: 0.0982 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0820 - val_loss: 0.0990 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0762 - val_loss: 0.1023 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0747 - val_loss: 0.0943 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.0835 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0827 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0788 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0721 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0640 - val_loss: 0.0721 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0770 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0739 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0784 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0785 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0767 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0637 - val_loss: 0.0738 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0680 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0628 - val_loss: 0.0648 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0635 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0622 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0619 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0616 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0614 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0613 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0613 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0612 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0612 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0612 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0611 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0611 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0611 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0611 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0611 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0611 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0611 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0611 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0611 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0611 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0611 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0611 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0611 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0611 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0611 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0611 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0611 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0611 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0611 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0611 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0611 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0611 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0611 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0611 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0611 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0611 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0611 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0611 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0611 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0611 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0611 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0611 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0611 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0611 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0611 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0611 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0611 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0611 - lr: 5.6464e-15
Epoch 1/100
2023-11-26 16:52:53.420466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:53.420899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:53.421494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:53.474668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:53.475064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:53.475422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:53.559379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:53.559827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:53.560221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:53.619437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:53.619905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:53.620332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:53.867185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:53.867682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:53.868318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:53.930719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:53.931170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:53.931542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 7ms/step - loss: 0.2215 - val_loss: 0.1787 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1275
2023-11-26 16:52:54.780089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:54.780642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:54.781034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:52:54.841015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:52:54.841449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:52:54.841777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 4ms/step - loss: 0.1732 - val_loss: 0.1470 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1459 - val_loss: 0.1314 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1355 - val_loss: 0.1189 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1211 - val_loss: 0.1120 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1129 - val_loss: 0.1034 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1041 - val_loss: 0.1030 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1017 - val_loss: 0.0929 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0924 - val_loss: 0.0903 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0917 - val_loss: 0.0870 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0844 - val_loss: 0.0823 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0798 - val_loss: 0.0778 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0746 - val_loss: 0.0734 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.0752 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.0729 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0710 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0738 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0640 - val_loss: 0.0745 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0704 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0678 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0675 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0672 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0671 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0529 - val_loss: 0.0662 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0523 - val_loss: 0.0657 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0659 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0652 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0497 - val_loss: 0.0647 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0645 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0640 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0636 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0635 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0633 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0633 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0633 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0632 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0632 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0631 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0631 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0631 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0631 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0631 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0631 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0631 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0631 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0631 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0631 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0631 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0631 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0631 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0631 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0631 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0631 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0631 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0631 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0631 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0631 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0631 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0631 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0631 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0631 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0631 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0631 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0631 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0631 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0631 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0631 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0631 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0631 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0631 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0631 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0631 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0631 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0631 - lr: 1.1370e-14
Average Validation Loss: 0.07698877304792404
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
2023-11-26 16:53:17.806564: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:17.806977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:17.807506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:17.860983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:17.861357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:17.861700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:17.945720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:17.946191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:17.946628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:18.006573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:18.006967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:18.007397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:18.242142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:18.242608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:18.243171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:18.300248: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:18.300697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:18.301120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.2488 - val_loss: 0.2693 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2127
2023-11-26 16:53:18.881271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:18.881777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:18.882455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:18.943732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:18.944202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:18.944610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 7ms/step - loss: 0.2420 - val_loss: 0.2500 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2243 - val_loss: 0.2258 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2034 - val_loss: 0.2220 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1934 - val_loss: 0.2158 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1838 - val_loss: 0.2029 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1704 - val_loss: 0.1972 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1527 - val_loss: 0.1919 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1492 - val_loss: 0.1666 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1474 - val_loss: 0.1866 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1407 - val_loss: 0.1853 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1358 - val_loss: 0.1547 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1199 - val_loss: 0.1753 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1209 - val_loss: 0.1619 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1139 - val_loss: 0.1624 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1115 - val_loss: 0.1585 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1095 - val_loss: 0.1580 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1076 - val_loss: 0.1512 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1072 - val_loss: 0.1537 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1061 - val_loss: 0.1547 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1065 - val_loss: 0.1467 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1050 - val_loss: 0.1488 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1030 - val_loss: 0.1463 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1033 - val_loss: 0.1464 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1008 - val_loss: 0.1476 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1020 - val_loss: 0.1447 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1003 - val_loss: 0.1459 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0999 - val_loss: 0.1473 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1003 - val_loss: 0.1474 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0997 - val_loss: 0.1466 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1017 - val_loss: 0.1449 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0990 - val_loss: 0.1442 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1005 - val_loss: 0.1444 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1003 - val_loss: 0.1452 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1005 - val_loss: 0.1453 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0996 - val_loss: 0.1455 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0999 - val_loss: 0.1455 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1003 - val_loss: 0.1454 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0993 - val_loss: 0.1455 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0990 - val_loss: 0.1455 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0995 - val_loss: 0.1455 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0995 - val_loss: 0.1455 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0994 - val_loss: 0.1455 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0998 - val_loss: 0.1455 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0998 - val_loss: 0.1455 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1004 - val_loss: 0.1454 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1001 - val_loss: 0.1454 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0992 - val_loss: 0.1454 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0992 - val_loss: 0.1454 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1003 - val_loss: 0.1454 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0988 - val_loss: 0.1454 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1012 - val_loss: 0.1454 - lr: 1.6702e-08
Epoch 1/100
2023-11-26 16:53:22.072747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:22.073173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:22.073684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:22.131968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:22.132412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:22.132770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:22.225034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:22.225485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:22.225891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:22.291276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:22.291897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:22.292284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:22.478232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:22.478696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:22.479118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:22.538560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:22.539118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:22.539668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.2751 - val_loss: 0.2035 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2069
2023-11-26 16:53:23.020403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:23.021058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:23.021576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:23.085278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:23.085698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:23.086069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.2415 - val_loss: 0.2007 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.2195 - val_loss: 0.1683 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.2058 - val_loss: 0.1635 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1962 - val_loss: 0.1530 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1825 - val_loss: 0.1450 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1772 - val_loss: 0.1377 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1663 - val_loss: 0.1427 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1613 - val_loss: 0.1263 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1544 - val_loss: 0.1272 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1394 - val_loss: 0.1448 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1374 - val_loss: 0.1299 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1354 - val_loss: 0.1196 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1266 - val_loss: 0.1189 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1203 - val_loss: 0.1241 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1160 - val_loss: 0.1159 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1120 - val_loss: 0.1130 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1096 - val_loss: 0.1139 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1095 - val_loss: 0.1179 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1063 - val_loss: 0.1075 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1030 - val_loss: 0.1070 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1013 - val_loss: 0.1110 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0983 - val_loss: 0.1093 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0981 - val_loss: 0.1044 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0969 - val_loss: 0.1100 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0980 - val_loss: 0.1069 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0953 - val_loss: 0.1066 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0959 - val_loss: 0.1061 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0955 - val_loss: 0.1065 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0963 - val_loss: 0.1069 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.1062 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0944 - val_loss: 0.1053 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0950 - val_loss: 0.1071 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0950 - val_loss: 0.1070 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0946 - val_loss: 0.1075 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0939 - val_loss: 0.1075 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.1070 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0948 - val_loss: 0.1067 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.1066 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.1066 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.1065 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0933 - val_loss: 0.1065 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.1065 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0933 - val_loss: 0.1065 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:53:26.656242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:26.656883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:26.657302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:26.713684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:26.714074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:26.714350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:26.799187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:26.799615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:26.800047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:26.863360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:26.863985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:26.864420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:27.105420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:27.105944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:27.106391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:27.165275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:27.165744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:27.166175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 15ms/step - loss: 0.2494 - val_loss: 0.2259 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1789
2023-11-26 16:53:27.852984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:27.853660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:27.854026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:27.918398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:27.918801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:27.919231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.2081 - val_loss: 0.2043 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1856 - val_loss: 0.1780 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1706 - val_loss: 0.1601 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1593 - val_loss: 0.1450 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1475 - val_loss: 0.1333 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1399 - val_loss: 0.1264 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1324 - val_loss: 0.1168 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1246 - val_loss: 0.1132 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1176 - val_loss: 0.1035 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1117 - val_loss: 0.1006 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 6ms/step - loss: 0.1015 - val_loss: 0.0867 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0994 - val_loss: 0.0905 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0803 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0902 - val_loss: 0.0829 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0796 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0789 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0784 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.0768 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.0726 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0741 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.0872 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0846 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0833 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0847 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0772 - val_loss: 0.0819 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0825 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0795 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0799 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0794 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0782 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0785 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0778 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0778 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0779 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0776 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0776 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0775 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0775 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0776 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:53:33.203661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:33.204149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:33.204653: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:33.266035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:33.266828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:33.267525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:33.356393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:33.356916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:33.357369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:33.424589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:33.425259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:33.425693: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:33.677028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:33.677649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:33.678071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:33.740123: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:33.740660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:33.741105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 2s 13ms/step - loss: 0.2385 - val_loss: 0.2065 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1683
2023-11-26 16:53:34.896985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:34.898192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:34.898791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:34.967956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:34.968429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:34.968813: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.1980 - val_loss: 0.1917 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1773 - val_loss: 0.1786 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1579 - val_loss: 0.1509 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1451 - val_loss: 0.1354 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1347 - val_loss: 0.1304 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1255 - val_loss: 0.1194 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1198 - val_loss: 0.1199 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1123 - val_loss: 0.1085 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1071 - val_loss: 0.1028 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0996 - val_loss: 0.1004 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0930 - val_loss: 0.0992 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.0924 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0902 - val_loss: 0.0873 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0855 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0836 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0817 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0790 - val_loss: 0.0831 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0817 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0816 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0813 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0818 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0909 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0888 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.0871 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.0748 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0693 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0670 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0662 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0659 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0654 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0650 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0647 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0647 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0646 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0645 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0645 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0645 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0645 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0645 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0645 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0645 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0645 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0644 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0644 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0644 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0692 - val_loss: 0.0644 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0644 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0644 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0644 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 6ms/step - loss: 0.0687 - val_loss: 0.0644 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0644 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0644 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0644 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.0644 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.0644 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0644 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0644 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0644 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.0644 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0692 - val_loss: 0.0644 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0644 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0644 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0644 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0644 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0644 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0683 - val_loss: 0.0644 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0644 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0644 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0644 - lr: 7.5826e-13
Epoch 1/100
2023-11-26 16:53:46.664901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:46.665322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:46.665802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:46.719068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:46.719456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:46.719804: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:46.812657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:46.813248: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:46.813739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:46.878477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:46.879089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:46.879588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:47.114316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:47.114763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:47.115324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:47.173739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:47.174197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:47.174656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 10ms/step - loss: 0.2370 - val_loss: 0.2036 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1640
2023-11-26 16:53:47.908214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:47.908754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:47.909208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:47.971113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:47.971553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:47.971939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.1921 - val_loss: 0.1754 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1643 - val_loss: 0.1547 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1447 - val_loss: 0.1404 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1333 - val_loss: 0.1309 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1198 - val_loss: 0.1220 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1140 - val_loss: 0.1190 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1102 - val_loss: 0.1232 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1058 - val_loss: 0.1194 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1043 - val_loss: 0.1149 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1008 - val_loss: 0.1110 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0951 - val_loss: 0.1053 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.1042 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0948 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0979 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.0922 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.0871 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0855 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0847 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0828 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0822 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0673 - val_loss: 0.0809 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0671 - val_loss: 0.0802 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0654 - val_loss: 0.0795 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0652 - val_loss: 0.0791 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.0781 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0657 - val_loss: 0.0778 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0655 - val_loss: 0.0776 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0640 - val_loss: 0.0776 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0639 - val_loss: 0.0776 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0776 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0776 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0776 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0776 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0775 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0775 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0775 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0775 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0775 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0624 - val_loss: 0.0775 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0775 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0775 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0775 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0775 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0775 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0775 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.0775 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0775 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0775 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.0775 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0775 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0631 - val_loss: 0.0775 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0775 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0775 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0775 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0775 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0775 - lr: 1.3710e-09
Average Validation Loss: 0.09263113588094711
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:53:59.446305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:59.447165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:59.447558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:59.504996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:59.505361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:59.505970: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:59.596154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:59.596631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:59.597119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:59.661519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:59.662126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:59.662585: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:59.918829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:59.919737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:59.920360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:53:59.984506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:53:59.984955: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:53:59.985398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 69ms/step - loss: 0.2781 - val_loss: 0.2615 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.2370
2023-11-26 16:54:00.586444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:00.586935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:00.587661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:00.651601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:00.652067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:00.652471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 11ms/step - loss: 0.2350 - val_loss: 0.2813 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2427 - val_loss: 0.2824 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2404 - val_loss: 0.2678 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 11ms/step - loss: 0.2269 - val_loss: 0.2490 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2171 - val_loss: 0.2347 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2092 - val_loss: 0.2275 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1994 - val_loss: 0.2274 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1948 - val_loss: 0.2269 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1867 - val_loss: 0.2179 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1771 - val_loss: 0.2075 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1646 - val_loss: 0.2043 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1583 - val_loss: 0.1954 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1501 - val_loss: 0.1912 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1459 - val_loss: 0.1915 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1429 - val_loss: 0.1870 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1405 - val_loss: 0.1843 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1379 - val_loss: 0.1888 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1374 - val_loss: 0.1819 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1362 - val_loss: 0.1822 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1323 - val_loss: 0.1847 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1350 - val_loss: 0.1803 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 13ms/step - loss: 0.1315 - val_loss: 0.1795 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1302 - val_loss: 0.1791 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1298 - val_loss: 0.1791 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1311 - val_loss: 0.1789 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1312 - val_loss: 0.1778 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1275 - val_loss: 0.1774 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1290 - val_loss: 0.1774 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1279 - val_loss: 0.1775 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1285 - val_loss: 0.1771 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1283 - val_loss: 0.1766 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1277 - val_loss: 0.1763 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1283 - val_loss: 0.1763 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1294 - val_loss: 0.1764 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1284 - val_loss: 0.1764 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1304 - val_loss: 0.1765 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1282 - val_loss: 0.1765 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1276 - val_loss: 0.1765 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1264 - val_loss: 0.1765 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1269 - val_loss: 0.1765 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1275 - val_loss: 0.1765 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1280 - val_loss: 0.1765 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1298 - val_loss: 0.1765 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1297 - val_loss: 0.1765 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1275 - val_loss: 0.1765 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1277 - val_loss: 0.1765 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1280 - val_loss: 0.1765 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1276 - val_loss: 0.1765 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1291 - val_loss: 0.1765 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1279 - val_loss: 0.1765 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1282 - val_loss: 0.1765 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1277 - val_loss: 0.1765 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:54:03.319487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:03.319855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:03.320192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:03.371826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:03.372245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:03.372611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:03.455634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:03.456119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:03.456529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:03.516686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:03.517180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:03.517606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:03.764428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:03.764882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:03.765411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:03.825696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:03.826190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:03.826605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 38ms/step - loss: 0.2738 - val_loss: 0.2097 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2663
2023-11-26 16:54:04.443465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:04.443979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:04.444535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:04.511518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:04.512064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:04.512433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 9ms/step - loss: 0.2460 - val_loss: 0.1908 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 9ms/step - loss: 0.2287 - val_loss: 0.1904 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 9ms/step - loss: 0.2168 - val_loss: 0.1704 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2045 - val_loss: 0.1719 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1939 - val_loss: 0.1756 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1814 - val_loss: 0.1832 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1751 - val_loss: 0.1723 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1651 - val_loss: 0.1623 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1555 - val_loss: 0.1639 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1488 - val_loss: 0.1603 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1443 - val_loss: 0.1547 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1415 - val_loss: 0.1464 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1357 - val_loss: 0.1545 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1339 - val_loss: 0.1424 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1300 - val_loss: 0.1394 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1246 - val_loss: 0.1417 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1221 - val_loss: 0.1346 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1207 - val_loss: 0.1297 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1194 - val_loss: 0.1343 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1173 - val_loss: 0.1283 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1143 - val_loss: 0.1295 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1149 - val_loss: 0.1264 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1136 - val_loss: 0.1268 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1125 - val_loss: 0.1300 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1135 - val_loss: 0.1259 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1118 - val_loss: 0.1273 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1115 - val_loss: 0.1285 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1101 - val_loss: 0.1264 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1110 - val_loss: 0.1260 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1111 - val_loss: 0.1259 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1116 - val_loss: 0.1257 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1110 - val_loss: 0.1256 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1103 - val_loss: 0.1257 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1110 - val_loss: 0.1259 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1105 - val_loss: 0.1261 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1100 - val_loss: 0.1263 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1105 - val_loss: 0.1264 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1098 - val_loss: 0.1264 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1102 - val_loss: 0.1264 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1089 - val_loss: 0.1264 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1115 - val_loss: 0.1263 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1101 - val_loss: 0.1263 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 10ms/step - loss: 0.1113 - val_loss: 0.1263 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1093 - val_loss: 0.1263 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1109 - val_loss: 0.1263 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1099 - val_loss: 0.1263 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1101 - val_loss: 0.1263 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1100 - val_loss: 0.1263 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1092 - val_loss: 0.1263 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1112 - val_loss: 0.1263 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1109 - val_loss: 0.1263 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1109 - val_loss: 0.1263 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:54:08.587982: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:08.588489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:08.589112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:08.648487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:08.648899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:08.649329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:08.732351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:08.732809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:08.733193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:08.795637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:08.796220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:08.796681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:09.031888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:09.032529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:09.032955: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:09.100592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:09.101058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:09.101457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 28ms/step - loss: 0.2487 - val_loss: 0.2310 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2512
2023-11-26 16:54:09.742636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:09.743145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:09.743837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:09.807324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:09.807812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:09.808219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 9ms/step - loss: 0.2230 - val_loss: 0.2231 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.2044 - val_loss: 0.2044 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1948 - val_loss: 0.1947 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1820 - val_loss: 0.1820 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1735 - val_loss: 0.1670 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1648 - val_loss: 0.1563 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1570 - val_loss: 0.1452 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1467 - val_loss: 0.1362 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1392 - val_loss: 0.1307 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1317 - val_loss: 0.1278 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 10ms/step - loss: 0.1286 - val_loss: 0.1203 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1251 - val_loss: 0.1171 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1167 - val_loss: 0.1129 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1133 - val_loss: 0.1113 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1117 - val_loss: 0.1076 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1079 - val_loss: 0.1045 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1049 - val_loss: 0.1028 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1058 - val_loss: 0.0995 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1004 - val_loss: 0.0979 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0978 - val_loss: 0.0961 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0950 - val_loss: 0.0947 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0953 - val_loss: 0.0942 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0930 - val_loss: 0.0932 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0918 - val_loss: 0.0924 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0916 - val_loss: 0.0919 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0915 - val_loss: 0.0917 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0905 - val_loss: 0.0912 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0897 - val_loss: 0.0912 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0905 - val_loss: 0.0909 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0892 - val_loss: 0.0912 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0906 - val_loss: 0.0912 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0886 - val_loss: 0.0908 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0888 - val_loss: 0.0908 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0882 - val_loss: 0.0908 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0896 - val_loss: 0.0908 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0892 - val_loss: 0.0908 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0890 - val_loss: 0.0908 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0889 - val_loss: 0.0908 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0900 - val_loss: 0.0908 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0890 - val_loss: 0.0908 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0889 - val_loss: 0.0908 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0889 - val_loss: 0.0908 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0888 - val_loss: 0.0908 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0897 - val_loss: 0.0908 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0890 - val_loss: 0.0908 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0897 - val_loss: 0.0908 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0899 - val_loss: 0.0908 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0890 - val_loss: 0.0908 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0897 - val_loss: 0.0908 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0893 - val_loss: 0.0908 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0882 - val_loss: 0.0908 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0903 - val_loss: 0.0908 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0907 - val_loss: 0.0908 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0885 - val_loss: 0.0908 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0897 - val_loss: 0.0908 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0885 - val_loss: 0.0908 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0891 - val_loss: 0.0908 - lr: 8.3153e-10
Epoch 1/100
2023-11-26 16:54:15.978768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:15.979258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:15.979579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:16.037120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:16.037489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:16.037844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:16.124659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:16.125111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:16.125501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:16.192939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:16.194007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:16.194749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:16.453475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:16.454019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:16.455109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:16.519910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:16.520364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:16.520863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 22ms/step - loss: 0.2455 - val_loss: 0.2277 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2508
2023-11-26 16:54:17.197284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:17.197871: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:17.198250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:17.261101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:17.261548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:17.261945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 8ms/step - loss: 0.2154 - val_loss: 0.2041 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1917 - val_loss: 0.1954 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1781 - val_loss: 0.2066 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1714 - val_loss: 0.2016 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1679 - val_loss: 0.1650 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 9ms/step - loss: 0.1495 - val_loss: 0.1479 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1365 - val_loss: 0.1382 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1273 - val_loss: 0.1269 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1232 - val_loss: 0.1279 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1212 - val_loss: 0.1395 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1192 - val_loss: 0.1384 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1208 - val_loss: 0.1259 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1170 - val_loss: 0.1085 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 9ms/step - loss: 0.1069 - val_loss: 0.1065 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1041 - val_loss: 0.1029 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1013 - val_loss: 0.0995 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1000 - val_loss: 0.0942 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0960 - val_loss: 0.0892 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0921 - val_loss: 0.0856 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0900 - val_loss: 0.0822 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0894 - val_loss: 0.0797 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0874 - val_loss: 0.0782 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0775 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0858 - val_loss: 0.0767 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0849 - val_loss: 0.0759 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0850 - val_loss: 0.0760 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0849 - val_loss: 0.0752 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0836 - val_loss: 0.0748 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0842 - val_loss: 0.0747 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0835 - val_loss: 0.0745 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0835 - val_loss: 0.0745 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0831 - val_loss: 0.0744 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0840 - val_loss: 0.0743 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0838 - val_loss: 0.0742 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0842 - val_loss: 0.0742 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0826 - val_loss: 0.0742 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0827 - val_loss: 0.0742 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0824 - val_loss: 0.0742 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0834 - val_loss: 0.0742 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0833 - val_loss: 0.0741 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0830 - val_loss: 0.0741 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0823 - val_loss: 0.0741 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0823 - val_loss: 0.0741 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0835 - val_loss: 0.0741 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0830 - val_loss: 0.0741 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0824 - val_loss: 0.0741 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0822 - val_loss: 0.0741 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0826 - val_loss: 0.0741 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0828 - val_loss: 0.0741 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0836 - val_loss: 0.0741 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0833 - val_loss: 0.0741 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0838 - val_loss: 0.0741 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0834 - val_loss: 0.0741 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0834 - val_loss: 0.0741 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0826 - val_loss: 0.0741 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0829 - val_loss: 0.0741 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0821 - val_loss: 0.0741 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0826 - val_loss: 0.0741 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0828 - val_loss: 0.0741 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0828 - val_loss: 0.0741 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0830 - val_loss: 0.0741 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0828 - val_loss: 0.0741 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0827 - val_loss: 0.0741 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0834 - val_loss: 0.0741 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0836 - val_loss: 0.0741 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0827 - val_loss: 0.0741 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0837 - val_loss: 0.0741 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0828 - val_loss: 0.0741 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0826 - val_loss: 0.0741 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0830 - val_loss: 0.0741 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0827 - val_loss: 0.0741 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0833 - val_loss: 0.0741 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0833 - val_loss: 0.0741 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0840 - val_loss: 0.0741 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0838 - val_loss: 0.0741 - lr: 1.1370e-14
Epoch 1/100
2023-11-26 16:54:27.640100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:27.640721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:27.641427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:27.702726: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:27.703179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:27.703549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:27.798192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:27.798939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:27.799466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:27.871132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:27.871671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:27.872332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:28.144222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:28.144885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:28.145425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:28.684175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:28.685367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:28.685906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 2s 20ms/step - loss: 0.2475 - val_loss: 0.2199 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2257
2023-11-26 16:54:29.437718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:29.438210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:29.439028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:29.511275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:29.511776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:29.512166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 8ms/step - loss: 0.2159 - val_loss: 0.2058 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1977 - val_loss: 0.1922 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 9ms/step - loss: 0.1840 - val_loss: 0.1806 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1726 - val_loss: 0.1687 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1598 - val_loss: 0.1593 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 9ms/step - loss: 0.1518 - val_loss: 0.1570 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1438 - val_loss: 0.1467 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1344 - val_loss: 0.1402 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 9ms/step - loss: 0.1262 - val_loss: 0.1316 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1195 - val_loss: 0.1323 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1196 - val_loss: 0.1342 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1165 - val_loss: 0.1314 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1102 - val_loss: 0.1249 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1039 - val_loss: 0.1229 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 9ms/step - loss: 0.0998 - val_loss: 0.1216 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0994 - val_loss: 0.1201 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0962 - val_loss: 0.1144 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0913 - val_loss: 0.1103 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0885 - val_loss: 0.1080 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0857 - val_loss: 0.1043 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0836 - val_loss: 0.1002 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0796 - val_loss: 0.0971 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0789 - val_loss: 0.0936 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0772 - val_loss: 0.0938 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 9ms/step - loss: 0.0776 - val_loss: 0.0910 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0768 - val_loss: 0.0899 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 9ms/step - loss: 0.0757 - val_loss: 0.0895 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0753 - val_loss: 0.0894 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0751 - val_loss: 0.0881 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0752 - val_loss: 0.0884 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0744 - val_loss: 0.0881 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0751 - val_loss: 0.0879 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 9ms/step - loss: 0.0745 - val_loss: 0.0876 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0744 - val_loss: 0.0876 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0744 - val_loss: 0.0878 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0747 - val_loss: 0.0877 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0739 - val_loss: 0.0876 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0742 - val_loss: 0.0876 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0741 - val_loss: 0.0875 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0742 - val_loss: 0.0875 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 9ms/step - loss: 0.0739 - val_loss: 0.0874 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0742 - val_loss: 0.0874 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0749 - val_loss: 0.0874 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0747 - val_loss: 0.0874 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0751 - val_loss: 0.0874 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0737 - val_loss: 0.0874 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0740 - val_loss: 0.0874 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 9ms/step - loss: 0.0743 - val_loss: 0.0874 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0747 - val_loss: 0.0874 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0751 - val_loss: 0.0874 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.0874 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0745 - val_loss: 0.0874 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0874 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0744 - val_loss: 0.0874 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0874 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0740 - val_loss: 0.0874 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0874 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0733 - val_loss: 0.0874 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0746 - val_loss: 0.0874 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0874 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0874 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0752 - val_loss: 0.0874 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0874 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0747 - val_loss: 0.0874 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0745 - val_loss: 0.0874 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0747 - val_loss: 0.0874 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0742 - val_loss: 0.0874 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0874 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0745 - val_loss: 0.0874 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0743 - val_loss: 0.0874 - lr: 3.7654e-13
Average Validation Loss: 0.11082569360733033
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:54:41.911340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:41.911792: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:41.912297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:41.967504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:41.968099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:41.968657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:42.056731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:42.057259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:42.057728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:42.122032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:42.122648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:42.123192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:42.383161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:42.383917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:42.384361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:42.448428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:42.449040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:42.449566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 21ms/step - loss: 0.2175 - val_loss: 0.2544 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.2353
2023-11-26 16:54:43.097099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:43.097576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:43.098261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:43.171017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:43.171496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:43.171879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.2198 - val_loss: 0.2181 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1975 - val_loss: 0.2064 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1758 - val_loss: 0.2002 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1692 - val_loss: 0.2050 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1567 - val_loss: 0.2050 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1586 - val_loss: 0.1694 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1222 - val_loss: 0.1921 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1181 - val_loss: 0.1651 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1114 - val_loss: 0.1477 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1067 - val_loss: 0.1430 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1107 - val_loss: 0.1420 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1092 - val_loss: 0.1600 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1063 - val_loss: 0.1591 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0960 - val_loss: 0.1451 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.1499 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0907 - val_loss: 0.1418 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.1407 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.1427 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.1415 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0851 - val_loss: 0.1425 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.1328 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1413 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.1324 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1401 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.1336 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.1331 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.1341 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1324 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.1350 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1315 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0777 - val_loss: 0.1321 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.1307 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.1312 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.1321 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.1312 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0786 - val_loss: 0.1316 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1319 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.1322 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.1319 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1320 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.1321 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.1322 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.1323 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.1323 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.1323 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.1323 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.1323 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.1323 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.1323 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.1323 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.1323 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1323 - lr: 1.0130e-08
Epoch 1/100
2023-11-26 16:54:47.749312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:47.749732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:47.750269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:47.804617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:47.805026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:47.805376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:47.899250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:47.900258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:47.900758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:47.967038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:47.967715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:47.968534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:48.170696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:48.171136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:48.171584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:48.237137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:48.237986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:48.238550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.2356 - val_loss: 0.1793 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1609
2023-11-26 16:54:48.774593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:48.775109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:48.775866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:48.843793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:48.844267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:48.844669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.2147 - val_loss: 0.1496 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1953 - val_loss: 0.1448 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1818 - val_loss: 0.1301 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1690 - val_loss: 0.1240 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1583 - val_loss: 0.1187 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1545 - val_loss: 0.1161 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1484 - val_loss: 0.1075 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1430 - val_loss: 0.1045 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1375 - val_loss: 0.1035 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1320 - val_loss: 0.1131 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1239 - val_loss: 0.1137 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1201 - val_loss: 0.0975 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1118 - val_loss: 0.1167 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1080 - val_loss: 0.0958 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1014 - val_loss: 0.1155 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0962 - val_loss: 0.1049 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0915 - val_loss: 0.0981 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0870 - val_loss: 0.0905 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0860 - val_loss: 0.0868 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0834 - val_loss: 0.0846 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0902 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0908 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0757 - val_loss: 0.0911 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0751 - val_loss: 0.0912 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0919 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0738 - val_loss: 0.0925 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0716 - val_loss: 0.0959 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.0939 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0933 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0939 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0948 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0950 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0954 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0951 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0950 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0947 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0950 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0951 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0952 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0952 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:54:53.416010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:53.416450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:53.416906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:53.475796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:53.476201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:53.476556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:53.569744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:53.570221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:53.570635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:53.636640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:53.637254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:53.637744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:53.892861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:53.893323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:53.894115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:53.953731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:53.954250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:53.954705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.2227 - val_loss: 0.1963 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1816
2023-11-26 16:54:54.706012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:54.707096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:54.707515: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:54:54.775790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:54:54.776242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:54:54.776669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1908 - val_loss: 0.1719 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1713 - val_loss: 0.1530 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1569 - val_loss: 0.1413 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1491 - val_loss: 0.1327 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1392 - val_loss: 0.1249 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1344 - val_loss: 0.1232 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1273 - val_loss: 0.1162 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1218 - val_loss: 0.1130 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1189 - val_loss: 0.1086 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1083 - val_loss: 0.0989 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1066 - val_loss: 0.0986 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0979 - val_loss: 0.0874 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0922 - val_loss: 0.0853 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0876 - val_loss: 0.0773 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0821 - val_loss: 0.0746 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0781 - val_loss: 0.0696 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.0657 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0683 - val_loss: 0.0637 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0644 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0661 - val_loss: 0.0618 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0638 - val_loss: 0.0610 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0609 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.0599 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0594 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0597 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0612 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0635 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0646 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0653 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0654 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0652 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0655 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0656 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0657 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0656 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0654 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0655 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0656 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0654 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0654 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0653 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0653 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0653 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0653 - lr: 3.3546e-07
Epoch 1/100
2023-11-26 16:55:03.557106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:03.557762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:03.558146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:03.616985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:03.617427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:03.617821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:03.702352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:03.702857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:03.703267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:03.766620: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:03.767316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:03.767919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:04.026576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:04.027056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:04.027612: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:04.090397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:04.090890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:04.091301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 8ms/step - loss: 0.2178 - val_loss: 0.2241 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.2186
2023-11-26 16:55:04.904802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:04.905374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:04.905768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:04.967604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:04.968015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:04.968366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1819 - val_loss: 0.1889 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1600 - val_loss: 0.1638 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1454 - val_loss: 0.1489 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1344 - val_loss: 0.1397 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1259 - val_loss: 0.1315 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1176 - val_loss: 0.1225 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1125 - val_loss: 0.1165 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1022 - val_loss: 0.1138 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0968 - val_loss: 0.1366 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0959 - val_loss: 0.1024 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0869 - val_loss: 0.0944 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0812 - val_loss: 0.1055 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0803 - val_loss: 0.0937 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0767 - val_loss: 0.0860 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.0805 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0782 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0761 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0757 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0682 - val_loss: 0.0711 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0649 - val_loss: 0.0711 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0716 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.0769 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0625 - val_loss: 0.0723 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0631 - val_loss: 0.0728 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.0726 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0688 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0654 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0624 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0601 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0593 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0589 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0587 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0586 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0585 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0585 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0584 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0584 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0584 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0583 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0583 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0583 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0583 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0583 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0583 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0583 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0583 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0583 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0597 - val_loss: 0.0583 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0583 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0583 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0583 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0583 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0583 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0583 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0583 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0583 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0583 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0583 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0583 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0583 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0583 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0583 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0583 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0583 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0583 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0583 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0583 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 6.9144e-16
Epoch 1/100
2023-11-26 16:55:24.573608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:24.574188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:24.574540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:24.628985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:24.629398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:24.629741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:24.714135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:24.714641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:24.715164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:24.776794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:24.777459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:24.777929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:25.019135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:25.019634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:25.020359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:25.080623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:25.081099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:25.081542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 7ms/step - loss: 0.2165 - val_loss: 0.1774 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1212
2023-11-26 16:55:25.943614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:25.944108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:25.944757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:26.006039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:26.006480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:26.006815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 4ms/step - loss: 0.1703 - val_loss: 0.1459 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1490 - val_loss: 0.1339 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1309 - val_loss: 0.1187 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1160 - val_loss: 0.1128 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1084 - val_loss: 0.1085 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1028 - val_loss: 0.1013 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0933 - val_loss: 0.0969 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0872 - val_loss: 0.0925 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0824 - val_loss: 0.0890 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0764 - val_loss: 0.0854 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.0798 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0796 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0784 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0707 - val_loss: 0.0772 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0743 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0768 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0655 - val_loss: 0.0747 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0631 - val_loss: 0.0748 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0725 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0711 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0693 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0677 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0555 - val_loss: 0.0665 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0654 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0651 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0653 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0526 - val_loss: 0.0648 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0648 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0649 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0644 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0516 - val_loss: 0.0640 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0640 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0639 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0639 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0638 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.0638 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0638 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0638 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0638 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0638 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0638 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0638 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0638 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0638 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0638 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0638 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0638 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0638 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0638 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0638 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0638 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0638 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0638 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0638 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0638 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0638 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0638 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0638 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0638 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0638 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0638 - lr: 9.2136e-11
Average Validation Loss: 0.07936186119914054
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 16:55:44.607920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:44.608524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:44.608968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:44.661345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:44.661739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:44.662100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:44.745507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:44.745992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:44.746404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:44.806297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:44.806771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:44.807178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:45.044620: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:45.045085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:45.045530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:45.103707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:45.104112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:45.104541: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 2s 37ms/step - loss: 0.2276 - val_loss: 0.2439 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1687
2023-11-26 16:55:46.116217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:46.116718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:46.117372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:46.178558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:46.179026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:46.179422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 7ms/step - loss: 0.2164 - val_loss: 0.2388 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.2104 - val_loss: 0.2246 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1993 - val_loss: 0.2170 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1909 - val_loss: 0.2092 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1838 - val_loss: 0.2027 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1726 - val_loss: 0.2000 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1657 - val_loss: 0.1886 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1542 - val_loss: 0.1857 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1494 - val_loss: 0.1687 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1299 - val_loss: 0.1645 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1225 - val_loss: 0.1573 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1208 - val_loss: 0.1602 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1109 - val_loss: 0.1781 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1187 - val_loss: 0.1479 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1040 - val_loss: 0.1579 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1048 - val_loss: 0.1510 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1017 - val_loss: 0.1511 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1015 - val_loss: 0.1533 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1004 - val_loss: 0.1480 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0988 - val_loss: 0.1495 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0996 - val_loss: 0.1452 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0982 - val_loss: 0.1482 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0984 - val_loss: 0.1457 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0968 - val_loss: 0.1490 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0973 - val_loss: 0.1437 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0960 - val_loss: 0.1435 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0960 - val_loss: 0.1439 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0951 - val_loss: 0.1456 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0946 - val_loss: 0.1450 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0956 - val_loss: 0.1447 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0941 - val_loss: 0.1443 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0937 - val_loss: 0.1445 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0952 - val_loss: 0.1448 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0949 - val_loss: 0.1447 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0963 - val_loss: 0.1447 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0948 - val_loss: 0.1448 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0952 - val_loss: 0.1447 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0968 - val_loss: 0.1447 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0957 - val_loss: 0.1446 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0946 - val_loss: 0.1445 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0958 - val_loss: 0.1445 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0947 - val_loss: 0.1445 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0939 - val_loss: 0.1445 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0960 - val_loss: 0.1445 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0943 - val_loss: 0.1445 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0939 - val_loss: 0.1445 - lr: 1.5073e-07
Epoch 1/100
2023-11-26 16:55:49.018206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:49.018790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:49.019193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:49.076100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:49.076487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:49.076863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:49.157935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:49.158420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:49.158928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:49.217666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:49.218176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:49.218595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:49.408223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:49.408712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:49.409187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:49.467861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:49.468315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:49.468889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.2504 - val_loss: 0.1926 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2070
2023-11-26 16:55:49.939211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:49.939810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:49.940186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:50.000692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:50.001153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:50.001551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.2218 - val_loss: 0.1871 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.2066 - val_loss: 0.1633 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1923 - val_loss: 0.1524 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1826 - val_loss: 0.1406 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1706 - val_loss: 0.1365 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1615 - val_loss: 0.1334 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1528 - val_loss: 0.1261 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1459 - val_loss: 0.1196 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1357 - val_loss: 0.1227 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1256 - val_loss: 0.1283 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1198 - val_loss: 0.1160 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1164 - val_loss: 0.1052 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1129 - val_loss: 0.0986 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1092 - val_loss: 0.0974 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1050 - val_loss: 0.1052 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0959 - val_loss: 0.1082 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.1160 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.1149 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0956 - val_loss: 0.1032 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.0969 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0989 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0875 - val_loss: 0.0981 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0865 - val_loss: 0.0998 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0995 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0861 - val_loss: 0.0993 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0999 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.1001 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0985 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.1002 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1014 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0868 - val_loss: 0.1007 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.0991 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0996 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.0991 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0988 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0989 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0990 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0992 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0992 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0991 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:55:53.362289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:53.362852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:53.363140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:53.418417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:53.418806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:53.419148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:53.504147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:53.504639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:53.505059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:53.565571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:53.566246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:53.566687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:53.803682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:53.804703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:53.805336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:53.865717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:53.866191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:53.866603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 15ms/step - loss: 0.2303 - val_loss: 0.2171 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1684
2023-11-26 16:55:54.526048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:54.526907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:54.527277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:55:54.589888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:55:54.590340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:55:54.590740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.2044 - val_loss: 0.1976 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1831 - val_loss: 0.1777 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1677 - val_loss: 0.1568 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1588 - val_loss: 0.1457 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1469 - val_loss: 0.1346 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1399 - val_loss: 0.1303 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1345 - val_loss: 0.1222 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1244 - val_loss: 0.1211 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1197 - val_loss: 0.1130 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1094 - val_loss: 0.1012 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1057 - val_loss: 0.1069 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1018 - val_loss: 0.0938 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.0955 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0950 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0930 - val_loss: 0.0964 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0978 - val_loss: 0.0912 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0961 - val_loss: 0.0862 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0846 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.0825 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0802 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0798 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0808 - val_loss: 0.0798 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.0791 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0788 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0786 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0782 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0787 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0784 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0781 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0778 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0781 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0777 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.0779 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0779 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0780 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0778 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0777 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0777 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0777 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0777 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0777 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0777 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.0777 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.0777 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0777 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0777 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0777 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0777 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0777 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0777 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0777 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0724 - val_loss: 0.0777 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0777 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0777 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0777 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0777 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0777 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0777 - lr: 5.0435e-10
Epoch 1/100
2023-11-26 16:56:02.404598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:02.405158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:02.405747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:02.465243: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:02.465657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:02.466007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:02.547608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:02.548095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:02.548501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:02.609436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:02.610009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:02.610490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:02.847315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:02.848116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:02.848592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:02.907616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:02.908084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:02.908513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 13ms/step - loss: 0.2234 - val_loss: 0.1995 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1720
2023-11-26 16:56:03.620144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:03.620621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:03.621303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:03.683054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:03.683482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:03.683952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.1922 - val_loss: 0.1955 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1753 - val_loss: 0.1894 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1624 - val_loss: 0.1779 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1489 - val_loss: 0.1752 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1413 - val_loss: 0.1536 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1310 - val_loss: 0.1434 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1257 - val_loss: 0.1278 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1177 - val_loss: 0.1214 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1130 - val_loss: 0.1204 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1056 - val_loss: 0.1066 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0997 - val_loss: 0.1066 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0964 - val_loss: 0.1032 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0912 - val_loss: 0.1006 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0921 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0865 - val_loss: 0.0983 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.0910 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0912 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0859 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.0930 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0876 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0955 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.0971 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0969 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0811 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.0753 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0735 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0720 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0715 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.0711 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0709 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0707 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0706 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0705 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0705 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0704 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0704 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0704 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0703 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0703 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0703 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0703 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0701 - val_loss: 0.0703 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0703 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0703 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0703 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0703 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0703 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0703 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0703 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0703 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0703 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0703 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0703 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0703 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0703 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0703 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0703 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0703 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0703 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0703 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.0703 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0703 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0703 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0703 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0703 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0703 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0703 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0703 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0703 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0703 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0703 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0703 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0703 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0703 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0703 - lr: 1.1370e-14
Epoch 1/100
2023-11-26 16:56:16.324027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:16.324478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:16.325096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:16.382538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:16.382936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:16.383280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:16.466142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:16.466640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:16.467060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:16.527585: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:16.528293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:16.528793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:16.777634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:16.778088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:16.778532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:16.839797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:16.840277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:16.840692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 11ms/step - loss: 0.2254 - val_loss: 0.1929 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1538
2023-11-26 16:56:17.583236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:17.583797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:17.584282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:17.645816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:17.646288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:17.646697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.1783 - val_loss: 0.1688 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1553 - val_loss: 0.1550 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1403 - val_loss: 0.1408 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1293 - val_loss: 0.1307 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1123 - val_loss: 0.1185 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1057 - val_loss: 0.1122 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1002 - val_loss: 0.1059 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0978 - val_loss: 0.1085 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.1022 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.1035 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.1099 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0899 - val_loss: 0.1048 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.0989 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0941 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0911 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0893 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0851 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0830 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0682 - val_loss: 0.0817 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0663 - val_loss: 0.0795 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0654 - val_loss: 0.0781 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0637 - val_loss: 0.0779 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0771 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0768 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0768 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0763 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0756 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0750 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0744 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0742 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0741 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0740 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0740 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0740 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0740 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0740 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0740 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0739 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0739 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0739 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0608 - val_loss: 0.0739 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0739 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0739 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0739 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0739 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0739 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0739 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0739 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0739 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0739 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0739 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0739 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0739 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0739 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0739 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0739 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0739 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0739 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0739 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0739 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0739 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0739 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0739 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0739 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0739 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0739 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0739 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0739 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0739 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0739 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0739 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0739 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0739 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0739 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0739 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0739 - lr: 5.6464e-15
Average Validation Loss: 0.09247076213359832
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 16:56:33.285394: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:33.285921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:33.286509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:33.342205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:33.342610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:33.342945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:33.426886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:33.427380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:33.427812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:33.487822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:33.488353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:33.488998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:33.743588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:33.744024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:33.744617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:33.810289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:33.810741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:33.811129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 68ms/step - loss: 0.3297 - val_loss: 0.2306 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1979
2023-11-26 16:56:34.379497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:34.379989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:34.380688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:34.443190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:34.443666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:34.444054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 10ms/step - loss: 0.2101 - val_loss: 0.2539 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2199 - val_loss: 0.2708 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2297 - val_loss: 0.2633 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2201 - val_loss: 0.2457 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2079 - val_loss: 0.2318 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1998 - val_loss: 0.2221 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1955 - val_loss: 0.2160 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1863 - val_loss: 0.2127 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1819 - val_loss: 0.2103 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1762 - val_loss: 0.2062 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1669 - val_loss: 0.1988 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1591 - val_loss: 0.1919 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1508 - val_loss: 0.1896 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1432 - val_loss: 0.1888 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1367 - val_loss: 0.1884 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1339 - val_loss: 0.1822 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1314 - val_loss: 0.1978 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1332 - val_loss: 0.1827 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1287 - val_loss: 0.1834 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1260 - val_loss: 0.1784 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1248 - val_loss: 0.1870 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1251 - val_loss: 0.1819 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1236 - val_loss: 0.1745 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1226 - val_loss: 0.1766 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1796 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1231 - val_loss: 0.1793 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1243 - val_loss: 0.1768 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1228 - val_loss: 0.1759 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1236 - val_loss: 0.1761 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1210 - val_loss: 0.1769 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1221 - val_loss: 0.1775 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1216 - val_loss: 0.1777 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1780 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1223 - val_loss: 0.1780 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1205 - val_loss: 0.1780 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1214 - val_loss: 0.1779 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1209 - val_loss: 0.1777 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1224 - val_loss: 0.1776 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1228 - val_loss: 0.1775 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1227 - val_loss: 0.1774 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1209 - val_loss: 0.1774 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1209 - val_loss: 0.1774 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1216 - val_loss: 0.1774 - lr: 5.0045e-07
Epoch 1/100
2023-11-26 16:56:36.657182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:36.657608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:36.658196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:36.713314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:36.713812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:36.714176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:36.802196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:36.802626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:36.803047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:36.864809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:36.865852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:36.866376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:37.109106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:37.109652: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:37.110073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:37.167847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:37.168305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:37.168712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 2s 37ms/step - loss: 0.2634 - val_loss: 0.1892 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2258
2023-11-26 16:56:38.184854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:38.185340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:38.186031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:38.248430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:38.248975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:38.249404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 9ms/step - loss: 0.2268 - val_loss: 0.1765 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2098 - val_loss: 0.1834 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1978 - val_loss: 0.1654 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1837 - val_loss: 0.1565 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1703 - val_loss: 0.1667 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1641 - val_loss: 0.1530 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1538 - val_loss: 0.1474 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1442 - val_loss: 0.1553 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1420 - val_loss: 0.1430 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1360 - val_loss: 0.1337 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1280 - val_loss: 0.1375 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1252 - val_loss: 0.1286 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1205 - val_loss: 0.1198 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1167 - val_loss: 0.1190 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1123 - val_loss: 0.1205 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1107 - val_loss: 0.1187 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1104 - val_loss: 0.1124 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1068 - val_loss: 0.1132 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1059 - val_loss: 0.1069 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1044 - val_loss: 0.1097 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1034 - val_loss: 0.1061 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1036 - val_loss: 0.1068 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1020 - val_loss: 0.1062 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1014 - val_loss: 0.1058 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1019 - val_loss: 0.1079 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1010 - val_loss: 0.1037 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0994 - val_loss: 0.1038 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0996 - val_loss: 0.1065 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0997 - val_loss: 0.1045 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0996 - val_loss: 0.1034 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0987 - val_loss: 0.1049 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0987 - val_loss: 0.1056 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0983 - val_loss: 0.1052 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1001 - val_loss: 0.1047 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1004 - val_loss: 0.1046 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0988 - val_loss: 0.1046 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0995 - val_loss: 0.1047 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0992 - val_loss: 0.1046 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0989 - val_loss: 0.1046 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0989 - val_loss: 0.1045 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0982 - val_loss: 0.1045 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0987 - val_loss: 0.1045 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0996 - val_loss: 0.1046 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0978 - val_loss: 0.1046 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0981 - val_loss: 0.1046 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0987 - val_loss: 0.1046 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0999 - val_loss: 0.1046 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0989 - val_loss: 0.1046 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0999 - val_loss: 0.1046 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0992 - val_loss: 0.1046 - lr: 2.7536e-08
Epoch 1/100
2023-11-26 16:56:42.093651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:42.094192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:42.094698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:42.152209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:42.152587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:42.152950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:42.235455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:42.235916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:42.236345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:42.297091: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:42.297623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:42.298069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:42.538141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:42.538827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:42.539271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:42.597359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:42.597823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:42.598268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 27ms/step - loss: 0.2466 - val_loss: 0.2242 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2344
2023-11-26 16:56:43.220071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:43.220552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:43.221218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:43.284447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:43.284905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:43.285288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 8ms/step - loss: 0.2154 - val_loss: 0.2166 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1958 - val_loss: 0.1945 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1819 - val_loss: 0.1776 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1712 - val_loss: 0.1582 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1621 - val_loss: 0.1489 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1520 - val_loss: 0.1344 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1431 - val_loss: 0.1230 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1322 - val_loss: 0.1167 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1297 - val_loss: 0.1108 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1217 - val_loss: 0.1065 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1128 - val_loss: 0.1012 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1068 - val_loss: 0.0965 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1022 - val_loss: 0.0936 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1012 - val_loss: 0.0925 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1007 - val_loss: 0.0922 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1001 - val_loss: 0.0998 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1011 - val_loss: 0.1175 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0976 - val_loss: 0.1060 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0917 - val_loss: 0.0949 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0902 - val_loss: 0.0955 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0893 - val_loss: 0.0948 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0898 - val_loss: 0.0958 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0883 - val_loss: 0.0917 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0878 - val_loss: 0.0912 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0874 - val_loss: 0.0918 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0903 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0872 - val_loss: 0.0929 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0862 - val_loss: 0.0909 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0920 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0900 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0852 - val_loss: 0.0902 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0905 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0909 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0852 - val_loss: 0.0910 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0857 - val_loss: 0.0909 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0908 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0859 - val_loss: 0.0905 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0905 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0905 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0858 - val_loss: 0.0905 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0905 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0850 - val_loss: 0.0905 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0850 - val_loss: 0.0905 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0905 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0853 - val_loss: 0.0905 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0905 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0862 - val_loss: 0.0905 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0905 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0853 - val_loss: 0.0905 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0851 - val_loss: 0.0905 - lr: 1.6702e-08
Epoch 1/100
2023-11-26 16:56:48.588314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:48.588736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:48.589358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:48.646969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:48.647393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:48.647746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:48.731806: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:48.732288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:48.732720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:48.793427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:48.793992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:48.794456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:49.046663: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:49.047084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:49.047696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:49.108322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:49.108762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:49.109150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 22ms/step - loss: 0.2269 - val_loss: 0.2102 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2243
2023-11-26 16:56:49.751653: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:49.752135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:49.752766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:49.813047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:49.813485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:49.813879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 7ms/step - loss: 0.2002 - val_loss: 0.2026 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1864 - val_loss: 0.1896 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1744 - val_loss: 0.1925 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1659 - val_loss: 0.1689 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1524 - val_loss: 0.1633 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1436 - val_loss: 0.1611 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1395 - val_loss: 0.1549 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1341 - val_loss: 0.1463 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1289 - val_loss: 0.1368 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1203 - val_loss: 0.1229 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1141 - val_loss: 0.1112 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1050 - val_loss: 0.1092 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1009 - val_loss: 0.1085 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0985 - val_loss: 0.1127 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0982 - val_loss: 0.1170 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1010 - val_loss: 0.1114 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1029 - val_loss: 0.0970 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0969 - val_loss: 0.0879 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0892 - val_loss: 0.0864 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0886 - val_loss: 0.0831 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0843 - val_loss: 0.0823 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0849 - val_loss: 0.0801 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0831 - val_loss: 0.0804 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0833 - val_loss: 0.0794 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0830 - val_loss: 0.0778 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0817 - val_loss: 0.0778 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0823 - val_loss: 0.0769 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0812 - val_loss: 0.0768 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0812 - val_loss: 0.0769 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0812 - val_loss: 0.0767 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0811 - val_loss: 0.0761 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0811 - val_loss: 0.0759 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0804 - val_loss: 0.0760 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0807 - val_loss: 0.0761 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0805 - val_loss: 0.0760 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0805 - val_loss: 0.0759 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0806 - val_loss: 0.0759 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0801 - val_loss: 0.0758 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.0758 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0799 - val_loss: 0.0758 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0795 - val_loss: 0.0758 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0804 - val_loss: 0.0758 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0801 - val_loss: 0.0758 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0795 - val_loss: 0.0758 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0802 - val_loss: 0.0758 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0795 - val_loss: 0.0758 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0803 - val_loss: 0.0758 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0807 - val_loss: 0.0758 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0799 - val_loss: 0.0758 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0802 - val_loss: 0.0758 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0806 - val_loss: 0.0758 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0794 - val_loss: 0.0758 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0796 - val_loss: 0.0758 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0805 - val_loss: 0.0758 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0801 - val_loss: 0.0758 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0803 - val_loss: 0.0758 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0793 - val_loss: 0.0758 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0795 - val_loss: 0.0758 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0802 - val_loss: 0.0758 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0803 - val_loss: 0.0758 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0802 - val_loss: 0.0758 - lr: 9.2136e-11
Epoch 1/100
2023-11-26 16:56:57.713315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:57.713762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:57.714371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:57.766399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:57.766794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:57.767141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:57.850327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:57.850830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:57.851257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:57.911894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:57.912283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:57.912720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:58.153571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:58.154031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:58.154501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:58.214020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:58.214498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:58.214920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 18ms/step - loss: 0.2261 - val_loss: 0.2012 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1900
2023-11-26 16:56:58.884212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:58.884772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:58.885364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:56:58.946453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:56:58.946884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:56:58.947287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 7ms/step - loss: 0.1922 - val_loss: 0.1807 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1747 - val_loss: 0.1647 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1620 - val_loss: 0.1532 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1494 - val_loss: 0.1457 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1413 - val_loss: 0.1379 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1299 - val_loss: 0.1302 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1220 - val_loss: 0.1253 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1131 - val_loss: 0.1191 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1080 - val_loss: 0.1145 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1035 - val_loss: 0.1144 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0993 - val_loss: 0.1050 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0940 - val_loss: 0.1101 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0959 - val_loss: 0.1012 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0890 - val_loss: 0.0983 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0884 - val_loss: 0.0968 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0855 - val_loss: 0.0949 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0841 - val_loss: 0.0937 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0826 - val_loss: 0.0929 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0821 - val_loss: 0.0920 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0815 - val_loss: 0.0927 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0829 - val_loss: 0.0945 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0833 - val_loss: 0.0964 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0823 - val_loss: 0.0929 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0805 - val_loss: 0.0896 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0781 - val_loss: 0.0885 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0773 - val_loss: 0.0877 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0779 - val_loss: 0.0874 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0771 - val_loss: 0.0869 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0764 - val_loss: 0.0867 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0765 - val_loss: 0.0866 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0769 - val_loss: 0.0867 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0766 - val_loss: 0.0865 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0761 - val_loss: 0.0864 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.0863 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0764 - val_loss: 0.0862 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0754 - val_loss: 0.0862 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0753 - val_loss: 0.0862 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0760 - val_loss: 0.0861 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0766 - val_loss: 0.0861 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0750 - val_loss: 0.0861 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0749 - val_loss: 0.0861 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0861 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0754 - val_loss: 0.0861 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0753 - val_loss: 0.0861 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0763 - val_loss: 0.0861 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0752 - val_loss: 0.0861 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0759 - val_loss: 0.0861 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0861 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0757 - val_loss: 0.0861 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0747 - val_loss: 0.0861 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0861 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0861 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0861 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0756 - val_loss: 0.0861 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0756 - val_loss: 0.0861 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0760 - val_loss: 0.0861 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0755 - val_loss: 0.0861 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0763 - val_loss: 0.0861 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0861 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0756 - val_loss: 0.0861 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0753 - val_loss: 0.0861 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0750 - val_loss: 0.0861 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0861 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0751 - val_loss: 0.0861 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0755 - val_loss: 0.0861 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0751 - val_loss: 0.0861 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0754 - val_loss: 0.0861 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0755 - val_loss: 0.0861 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0861 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0759 - val_loss: 0.0861 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0755 - val_loss: 0.0861 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0755 - val_loss: 0.0861 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0748 - val_loss: 0.0861 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0760 - val_loss: 0.0861 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0755 - val_loss: 0.0861 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0753 - val_loss: 0.0861 - lr: 5.6464e-15
Average Validation Loss: 0.10593558847904205
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
2023-11-26 16:57:11.117636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:11.118130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:11.118507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:11.171523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:11.171943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:11.172300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:11.255462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:11.256014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:11.256461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:11.316662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:11.317157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:11.317689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:11.556100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:11.556558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:11.557007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:11.616563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:11.617093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:11.617537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 20ms/step - loss: 0.1285 - val_loss: 0.1774 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1536
2023-11-26 16:57:12.235816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:12.236433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:12.236823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:12.302874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:12.303443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:12.303992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.1426 - val_loss: 0.1343 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1168 - val_loss: 0.1328 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1108 - val_loss: 0.1363 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1104 - val_loss: 0.1331 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1046 - val_loss: 0.1312 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1006 - val_loss: 0.1366 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1006 - val_loss: 0.1271 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.1203 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.1279 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0672 - val_loss: 0.1158 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.1121 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0811 - val_loss: 0.1171 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.1213 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.1075 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.1051 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.1046 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.1030 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.1119 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.1016 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.1012 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.1068 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.1051 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0996 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.1016 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.1002 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.1018 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.1029 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.0988 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.1015 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.1045 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.1048 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.1049 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.1035 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.1035 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0446 - val_loss: 0.1033 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0442 - val_loss: 0.1034 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.1034 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.1035 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.1034 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.1034 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.1033 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.1033 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.1032 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.1031 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.1031 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.1031 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.1031 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.1031 - lr: 6.7729e-08
Epoch 1/100
2023-11-26 16:57:16.438114: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:16.438559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:16.439033: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:16.499909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:16.500317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:16.500669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:16.584936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:16.585434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:16.585847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:16.645702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:16.646253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:16.646768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:16.832807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:16.833257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:16.833682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:16.892291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:16.892923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:16.893371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1398 - val_loss: 0.1064 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0562
2023-11-26 16:57:17.401620: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:17.402050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:17.402578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:17.464962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:17.465431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:17.465813: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1347 - val_loss: 0.0815 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1275 - val_loss: 0.0823 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1227 - val_loss: 0.0789 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1188 - val_loss: 0.0790 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1148 - val_loss: 0.0815 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1125 - val_loss: 0.0698 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1111 - val_loss: 0.0838 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1080 - val_loss: 0.0658 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1037 - val_loss: 0.0875 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1018 - val_loss: 0.0630 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0956 - val_loss: 0.0860 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0916 - val_loss: 0.0657 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0890 - val_loss: 0.0727 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0828 - val_loss: 0.0719 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0688 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0601 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0554 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0552 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0550 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0512 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0507 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0534 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0575 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0536 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0534 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0548 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0565 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0546 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0554 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0551 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0567 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0552 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0557 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0563 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0561 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0564 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0565 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0568 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0570 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0570 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0570 - lr: 1.1138e-06
Epoch 1/100
2023-11-26 16:57:22.102196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:22.102604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:22.103209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:22.162033: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:22.162441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:22.162796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:22.247952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:22.248422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:22.248825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:22.312440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:22.312999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:22.313435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:22.552559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:22.553011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:22.553553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:22.612619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:22.613068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:22.613485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 2s 9ms/step - loss: 0.1282 - val_loss: 0.1141 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1170
2023-11-26 16:57:23.782415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:23.782934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:23.783626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:23.848342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:23.848810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:23.849293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1159 - val_loss: 0.1053 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1129 - val_loss: 0.1015 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1062 - val_loss: 0.0945 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1046 - val_loss: 0.0938 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1006 - val_loss: 0.0883 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0991 - val_loss: 0.0870 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0978 - val_loss: 0.0863 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0908 - val_loss: 0.0802 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0915 - val_loss: 0.0810 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0817 - val_loss: 0.0710 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0783 - val_loss: 0.0752 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0734 - val_loss: 0.0636 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.0585 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0571 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0543 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0511 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0497 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0479 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0487 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0447 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0471 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0457 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0449 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0449 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0473 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0508 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0516 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0527 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0534 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0521 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0523 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0527 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0447 - val_loss: 0.0525 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0524 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0525 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0526 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0524 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0524 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0525 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0524 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 16:57:31.775714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:31.776462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:31.776893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:31.831520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:31.831948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:31.832263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:31.914289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:31.914852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:31.915361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:31.976454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:31.976930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:31.977683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:32.215208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:32.215753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:32.216345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:32.274224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:32.274689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:32.275092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 8ms/step - loss: 0.1317 - val_loss: 0.1448 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1413
2023-11-26 16:57:33.067853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:33.068587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:33.069008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:33.131740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:33.132189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:33.132577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1214 - val_loss: 0.1399 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1175 - val_loss: 0.1135 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1063 - val_loss: 0.1262 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1040 - val_loss: 0.1020 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0957 - val_loss: 0.0962 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0887 - val_loss: 0.0998 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0836 - val_loss: 0.1014 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0778 - val_loss: 0.1152 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.1290 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0714 - val_loss: 0.0976 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0874 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0884 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0830 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0733 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0695 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0711 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0687 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0533 - val_loss: 0.0679 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0694 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0667 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0717 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0699 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0718 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0698 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0693 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0631 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0582 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0569 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0550 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0538 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0536 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0531 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0529 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0526 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0525 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0524 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0524 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0523 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0523 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0522 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0522 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0522 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0522 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0522 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0522 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0522 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0522 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0522 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0522 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0522 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0522 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0522 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0522 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0522 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0522 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0522 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0522 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0522 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0522 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0522 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0522 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0522 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0522 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0522 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0522 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0522 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0522 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0522 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0522 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0522 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0522 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0522 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0522 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0522 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0522 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0522 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0522 - lr: 2.8039e-15
Epoch 1/100
2023-11-26 16:57:52.483602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:52.484187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:52.484572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:52.543076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:52.543559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:52.544021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:52.626787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:52.627247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:52.627628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:52.690262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:52.690889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:52.691347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:52.938378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:52.939206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:52.939729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:53.000737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:53.001226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:53.001654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 7ms/step - loss: 0.1311 - val_loss: 0.1114 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0676
2023-11-26 16:57:53.863590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:53.864071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:53.864781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:57:53.928158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:57:53.928621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:57:53.929016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 4ms/step - loss: 0.1136 - val_loss: 0.1036 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1041 - val_loss: 0.1008 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0977 - val_loss: 0.0998 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0862 - val_loss: 0.0953 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0817 - val_loss: 0.0935 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0763 - val_loss: 0.0924 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0733 - val_loss: 0.0892 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0878 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.0874 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.0878 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0632 - val_loss: 0.0852 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0638 - val_loss: 0.0826 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0796 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0797 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0572 - val_loss: 0.0783 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0528 - val_loss: 0.0772 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0762 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0751 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0504 - val_loss: 0.0735 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0716 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0702 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0692 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0682 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0425 - val_loss: 0.0676 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0418 - val_loss: 0.0671 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0665 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0659 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0399 - val_loss: 0.0656 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0648 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0643 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0395 - val_loss: 0.0635 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0396 - val_loss: 0.0633 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0631 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0393 - val_loss: 0.0628 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0399 - val_loss: 0.0627 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0388 - val_loss: 0.0626 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0386 - val_loss: 0.0625 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0382 - val_loss: 0.0624 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0386 - val_loss: 0.0624 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0624 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0393 - val_loss: 0.0623 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0388 - val_loss: 0.0623 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0393 - val_loss: 0.0623 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0392 - val_loss: 0.0623 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0388 - val_loss: 0.0623 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0391 - val_loss: 0.0623 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0623 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0623 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0394 - val_loss: 0.0623 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0391 - val_loss: 0.0623 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0623 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0623 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0387 - val_loss: 0.0623 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0623 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0393 - val_loss: 0.0623 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0623 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0389 - val_loss: 0.0623 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0623 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0623 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0623 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0388 - val_loss: 0.0623 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0623 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0623 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0382 - val_loss: 0.0623 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0623 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0385 - val_loss: 0.0623 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0623 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0387 - val_loss: 0.0623 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0623 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0389 - val_loss: 0.0623 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0396 - val_loss: 0.0623 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0389 - val_loss: 0.0623 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0388 - val_loss: 0.0623 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0386 - val_loss: 0.0623 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0623 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0396 - val_loss: 0.0623 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0389 - val_loss: 0.0623 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0388 - val_loss: 0.0623 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0623 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0386 - val_loss: 0.0623 - lr: 3.1068e-16
Epoch 82/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0391 - val_loss: 0.0623 - lr: 1.3960e-16
Average Validation Loss: 0.06176652610301971
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
2023-11-26 16:58:18.547513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:18.548039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:18.548385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:18.603070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:18.603545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:18.604002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:18.689624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:18.690084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:18.690491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:18.750928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:18.751567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:18.752023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:18.990041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:18.990712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:18.991146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:19.049719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:19.050162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:19.050577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 37ms/step - loss: 0.1479 - val_loss: 0.1509 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0741
2023-11-26 16:58:19.644452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:19.644911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:19.645574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:19.706550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:19.707024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:19.707433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 7ms/step - loss: 0.1259 - val_loss: 0.1520 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1217 - val_loss: 0.1366 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1155 - val_loss: 0.1302 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1099 - val_loss: 0.1326 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1039 - val_loss: 0.1307 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0951 - val_loss: 0.1276 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0912 - val_loss: 0.1230 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0821 - val_loss: 0.1080 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.1203 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0645 - val_loss: 0.1276 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0663 - val_loss: 0.1000 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0597 - val_loss: 0.1179 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0605 - val_loss: 0.1042 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0575 - val_loss: 0.1089 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0579 - val_loss: 0.1101 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0556 - val_loss: 0.1007 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0540 - val_loss: 0.1095 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0545 - val_loss: 0.1004 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0543 - val_loss: 0.1100 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0532 - val_loss: 0.1022 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0539 - val_loss: 0.1019 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0521 - val_loss: 0.1059 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0534 - val_loss: 0.1009 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0519 - val_loss: 0.1025 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0534 - val_loss: 0.1023 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0509 - val_loss: 0.1032 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0520 - val_loss: 0.1036 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0516 - val_loss: 0.1021 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0516 - val_loss: 0.1010 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0540 - val_loss: 0.1007 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0515 - val_loss: 0.1013 - lr: 2.7324e-05
Epoch 1/100
2023-11-26 16:58:21.667751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:21.668140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:21.668490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:21.725265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:21.725659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:21.725996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:21.809998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:21.810474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:21.810896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:21.874720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:21.875442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:21.875858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:22.063374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:22.063903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:22.064327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:22.123491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:22.123959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:22.124428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 19ms/step - loss: 0.1668 - val_loss: 0.1055 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1287
2023-11-26 16:58:22.602897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:22.603369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:22.603990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:22.665461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:22.665933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:22.666332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 4ms/step - loss: 0.1364 - val_loss: 0.0966 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1268 - val_loss: 0.0790 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1161 - val_loss: 0.0811 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1135 - val_loss: 0.0710 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1059 - val_loss: 0.0746 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1017 - val_loss: 0.0729 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0974 - val_loss: 0.0773 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0929 - val_loss: 0.0723 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0890 - val_loss: 0.0686 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0639 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0662 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0787 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0692 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0667 - val_loss: 0.0654 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0662 - val_loss: 0.0570 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.0575 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0668 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0726 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0693 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0680 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0678 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0673 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0701 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0667 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0745 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0664 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0702 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0723 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0716 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0696 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0703 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0705 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0704 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0701 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0701 - lr: 8.2297e-06
Epoch 1/100
2023-11-26 16:58:25.564409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:25.564855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:25.565451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:25.617134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:25.617514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:25.617864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:25.705139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:25.705640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:25.706071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:25.771624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:25.772510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:25.772967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:26.014826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:26.015291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:26.015743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:26.075444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:26.075904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:26.076237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 15ms/step - loss: 0.1299 - val_loss: 0.1277 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0697
2023-11-26 16:58:26.742294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:26.742949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:26.743395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:26.805866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:26.806304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:26.806749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.1132 - val_loss: 0.1099 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1093 - val_loss: 0.0975 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1049 - val_loss: 0.0895 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1000 - val_loss: 0.0847 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0972 - val_loss: 0.0811 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0923 - val_loss: 0.0782 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.0736 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0838 - val_loss: 0.0712 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0658 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.0626 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0602 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0650 - val_loss: 0.0558 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0543 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0535 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0592 - val_loss: 0.0508 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0517 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0496 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0484 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0478 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0615 - val_loss: 0.0520 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0653 - val_loss: 0.0770 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0658 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0678 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0644 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0619 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0615 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0593 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0586 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0588 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0571 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0581 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0577 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0578 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0577 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0570 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0569 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0569 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0570 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0570 - lr: 2.4788e-06
Epoch 1/100
2023-11-26 16:58:32.050272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:32.050758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:32.051132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:32.106472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:32.106838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:32.107203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:32.192650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:32.193166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:32.193591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:32.259405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:32.260245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:32.260717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:32.499078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:32.499588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:32.500170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:32.558626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:32.559076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:32.559489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 2s 12ms/step - loss: 0.1356 - val_loss: 0.1204 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0923
2023-11-26 16:58:33.696307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:33.696848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:33.697305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:33.758760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:33.759211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:33.759596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.1161 - val_loss: 0.1324 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1110 - val_loss: 0.1368 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1056 - val_loss: 0.1288 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0991 - val_loss: 0.1108 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0937 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.0919 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0906 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0833 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0884 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0747 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0684 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0641 - val_loss: 0.0675 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0614 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0626 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0615 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0572 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0669 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0599 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0628 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0636 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0824 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0784 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0652 - val_loss: 0.0586 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0526 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0500 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0490 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0485 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0482 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0481 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0479 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0479 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0478 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0478 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0478 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0478 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0477 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0477 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0477 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0477 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0477 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0477 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0477 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0477 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0477 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0477 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0477 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0477 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0477 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0477 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0477 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0477 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0477 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0477 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0477 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0477 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0477 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0477 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0477 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0477 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0477 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0477 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0477 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0477 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0477 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0477 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0477 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0477 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0477 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0477 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0477 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0477 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0477 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0477 - lr: 4.6110e-14
Epoch 1/100
2023-11-26 16:58:46.103790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:46.104219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:46.104724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:46.160830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:46.161221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:46.161562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:46.243772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:46.244233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:46.244673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:46.305630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:46.306273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:46.306782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:46.558614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:46.559380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:46.559837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:46.621957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:46.622445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:46.622853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 11ms/step - loss: 0.1301 - val_loss: 0.1131 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0695
2023-11-26 16:58:47.373130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:47.373563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:47.374062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:58:47.436475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:58:47.436928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:58:47.437313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.1051 - val_loss: 0.1056 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0959 - val_loss: 0.1016 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0978 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0953 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0920 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0889 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0881 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0881 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0856 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0839 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0811 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0774 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0745 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0733 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0731 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0719 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0710 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0690 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0687 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0666 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0652 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0635 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0628 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0628 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0625 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0621 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0606 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0595 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0446 - val_loss: 0.0585 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0576 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0572 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0569 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0567 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0566 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0565 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0564 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.0563 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0563 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0563 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0563 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.0563 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.0562 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0423 - val_loss: 0.0562 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0562 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0562 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0423 - val_loss: 0.0562 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0562 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0562 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0562 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0562 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.0562 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.0562 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0562 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.0562 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0562 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0562 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0562 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0562 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0562 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0562 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0562 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0562 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0562 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.0562 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0562 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.0562 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0562 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0562 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0562 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0562 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0562 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.0562 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.0562 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0562 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.0562 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0562 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0562 - lr: 2.8039e-15
Epoch 79/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0562 - lr: 1.3924e-15
Epoch 80/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0562 - lr: 6.9144e-16
Epoch 81/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0562 - lr: 3.1068e-16
Average Validation Loss: 0.06175290122628212
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
2023-11-26 16:59:03.876298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:03.876709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:03.877297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:03.933187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:03.933525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:03.933892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:04.016956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:04.017425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:04.017877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:04.085151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:04.086170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:04.086818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:04.336432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:04.336893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:04.337330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:04.396082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:04.396537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:04.396953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 68ms/step - loss: 0.1833 - val_loss: 0.1441 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1004
2023-11-26 16:59:04.966577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:04.967087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:04.967498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:05.028730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:05.029194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:05.029607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 11ms/step - loss: 0.1164 - val_loss: 0.1573 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1286 - val_loss: 0.1677 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1309 - val_loss: 0.1571 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1212 - val_loss: 0.1407 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1137 - val_loss: 0.1295 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1047 - val_loss: 0.1261 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1042 - val_loss: 0.1284 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0982 - val_loss: 0.1330 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0976 - val_loss: 0.1337 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0941 - val_loss: 0.1270 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0892 - val_loss: 0.1196 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0834 - val_loss: 0.1203 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0758 - val_loss: 0.1171 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0717 - val_loss: 0.1133 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0680 - val_loss: 0.1120 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0665 - val_loss: 0.1200 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0665 - val_loss: 0.1151 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0627 - val_loss: 0.1081 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0629 - val_loss: 0.1160 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0644 - val_loss: 0.1109 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0628 - val_loss: 0.1114 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0608 - val_loss: 0.1106 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0607 - val_loss: 0.1108 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0589 - val_loss: 0.1128 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0618 - val_loss: 0.1143 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0592 - val_loss: 0.1121 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0600 - val_loss: 0.1089 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0578 - val_loss: 0.1073 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0623 - val_loss: 0.1076 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0593 - val_loss: 0.1081 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0588 - val_loss: 0.1088 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0583 - val_loss: 0.1093 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0576 - val_loss: 0.1096 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0576 - val_loss: 0.1097 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0591 - val_loss: 0.1097 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0600 - val_loss: 0.1096 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0582 - val_loss: 0.1096 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0594 - val_loss: 0.1096 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0590 - val_loss: 0.1096 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0584 - val_loss: 0.1097 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0579 - val_loss: 0.1096 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0602 - val_loss: 0.1096 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0599 - val_loss: 0.1096 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0583 - val_loss: 0.1096 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0582 - val_loss: 0.1096 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0575 - val_loss: 0.1096 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0589 - val_loss: 0.1096 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0580 - val_loss: 0.1096 - lr: 6.7729e-08
Epoch 1/100
2023-11-26 16:59:07.499734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:07.500142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:07.500723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:07.554047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:07.554435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:07.554772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:07.638697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:07.639159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:07.639572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:07.699193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:07.699640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:07.700065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:07.941725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:07.942330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:07.942775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:08.003118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:08.003682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:08.004172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 1s 39ms/step - loss: 0.1599 - val_loss: 0.0966 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1448
2023-11-26 16:59:08.610926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:08.611895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:08.612348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:08.677537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:08.678048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:08.678457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 9ms/step - loss: 0.1361 - val_loss: 0.0864 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1242 - val_loss: 0.0946 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1174 - val_loss: 0.0794 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1079 - val_loss: 0.0779 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1025 - val_loss: 0.0867 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0971 - val_loss: 0.0885 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0970 - val_loss: 0.0800 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0898 - val_loss: 0.0824 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0844 - val_loss: 0.0789 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0823 - val_loss: 0.0860 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0811 - val_loss: 0.0717 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0751 - val_loss: 0.0755 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0707 - val_loss: 0.0841 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0721 - val_loss: 0.0742 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0679 - val_loss: 0.0786 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0666 - val_loss: 0.0728 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0646 - val_loss: 0.0728 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0635 - val_loss: 0.0744 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0623 - val_loss: 0.0684 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0603 - val_loss: 0.0748 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0609 - val_loss: 0.0657 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0600 - val_loss: 0.0721 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0601 - val_loss: 0.0677 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0591 - val_loss: 0.0682 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0603 - val_loss: 0.0674 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0584 - val_loss: 0.0686 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0591 - val_loss: 0.0691 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0593 - val_loss: 0.0691 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0573 - val_loss: 0.0702 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0586 - val_loss: 0.0700 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0568 - val_loss: 0.0689 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0584 - val_loss: 0.0681 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0584 - val_loss: 0.0682 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0572 - val_loss: 0.0684 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0580 - val_loss: 0.0684 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0576 - val_loss: 0.0685 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0569 - val_loss: 0.0687 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0569 - val_loss: 0.0688 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0586 - val_loss: 0.0688 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0575 - val_loss: 0.0688 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0578 - val_loss: 0.0687 - lr: 1.1138e-06
Epoch 1/100
2023-11-26 16:59:11.891221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:11.891626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:11.892217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:11.945839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:11.946227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:11.946595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:12.031609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:12.032111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:12.032534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:12.092662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:12.093402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:12.094029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:12.332878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:12.333466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:12.333924: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:12.392144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:12.392594: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:12.393014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 27ms/step - loss: 0.1453 - val_loss: 0.1242 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1402
2023-11-26 16:59:13.009177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:13.009667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:13.010324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:13.073582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:13.074018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:13.074490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 7ms/step - loss: 0.1215 - val_loss: 0.1275 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1110 - val_loss: 0.1146 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1063 - val_loss: 0.1028 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1021 - val_loss: 0.0928 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0988 - val_loss: 0.0869 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0925 - val_loss: 0.0773 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0908 - val_loss: 0.0763 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0859 - val_loss: 0.0715 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0823 - val_loss: 0.0666 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0803 - val_loss: 0.0647 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0778 - val_loss: 0.0648 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0755 - val_loss: 0.0673 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0701 - val_loss: 0.0635 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0694 - val_loss: 0.0645 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0661 - val_loss: 0.0590 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0645 - val_loss: 0.0604 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0639 - val_loss: 0.0608 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0613 - val_loss: 0.0573 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0610 - val_loss: 0.0570 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0594 - val_loss: 0.0589 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0590 - val_loss: 0.0556 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0575 - val_loss: 0.0566 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0558 - val_loss: 0.0555 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0565 - val_loss: 0.0558 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0573 - val_loss: 0.0553 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0563 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0542 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0554 - val_loss: 0.0547 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0552 - val_loss: 0.0557 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0556 - val_loss: 0.0546 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0543 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0551 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0557 - val_loss: 0.0546 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0564 - val_loss: 0.0550 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0540 - val_loss: 0.0553 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0551 - val_loss: 0.0552 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0549 - val_loss: 0.0551 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0542 - val_loss: 0.0550 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0544 - val_loss: 0.0551 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0550 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0550 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0547 - val_loss: 0.0550 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0541 - val_loss: 0.0550 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0542 - val_loss: 0.0549 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0550 - val_loss: 0.0549 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0547 - val_loss: 0.0549 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0545 - val_loss: 0.0549 - lr: 1.0104e-07
Epoch 1/100
2023-11-26 16:59:17.943250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:17.943687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:17.944060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:18.003414: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:18.003822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:18.004170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:18.088090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:18.088546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:18.088959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:18.150247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:18.150878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:18.151278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:18.391422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:18.391998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:18.392451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:18.451081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:18.451546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:18.451962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 22ms/step - loss: 0.1272 - val_loss: 0.1126 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1233
2023-11-26 16:59:19.097410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:19.098096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:19.098621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:19.159011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:19.159444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:19.159826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 7ms/step - loss: 0.1107 - val_loss: 0.1197 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1058 - val_loss: 0.1336 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1073 - val_loss: 0.1081 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0973 - val_loss: 0.1095 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0938 - val_loss: 0.1321 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0997 - val_loss: 0.0960 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0888 - val_loss: 0.0919 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0791 - val_loss: 0.1050 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0771 - val_loss: 0.1104 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.1166 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0895 - val_loss: 0.0782 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0764 - val_loss: 0.0762 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0908 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0759 - val_loss: 0.0657 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0668 - val_loss: 0.0663 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0640 - val_loss: 0.0694 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0648 - val_loss: 0.0574 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0600 - val_loss: 0.0546 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0588 - val_loss: 0.0520 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0578 - val_loss: 0.0521 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0563 - val_loss: 0.0487 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0557 - val_loss: 0.0477 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0542 - val_loss: 0.0478 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0471 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0539 - val_loss: 0.0484 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0537 - val_loss: 0.0470 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0527 - val_loss: 0.0475 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0530 - val_loss: 0.0471 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0525 - val_loss: 0.0469 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0526 - val_loss: 0.0469 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0527 - val_loss: 0.0471 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0517 - val_loss: 0.0472 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0527 - val_loss: 0.0470 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0527 - val_loss: 0.0468 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0531 - val_loss: 0.0467 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0524 - val_loss: 0.0467 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0523 - val_loss: 0.0467 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0519 - val_loss: 0.0467 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0514 - val_loss: 0.0468 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0521 - val_loss: 0.0468 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0519 - val_loss: 0.0468 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0524 - val_loss: 0.0468 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0517 - val_loss: 0.0468 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0513 - val_loss: 0.0468 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0531 - val_loss: 0.0468 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0528 - val_loss: 0.0468 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0519 - val_loss: 0.0468 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0518 - val_loss: 0.0468 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0527 - val_loss: 0.0468 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0517 - val_loss: 0.0468 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0520 - val_loss: 0.0468 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0522 - val_loss: 0.0468 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0526 - val_loss: 0.0468 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0518 - val_loss: 0.0468 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0520 - val_loss: 0.0468 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0520 - val_loss: 0.0468 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0519 - val_loss: 0.0468 - lr: 8.3153e-10
Epoch 1/100
2023-11-26 16:59:26.528276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:26.528928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:26.529389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:26.589911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:26.590327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:26.590672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:26.672121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:26.672614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:26.673059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:26.733963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:26.734671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:26.735088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:26.974458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:26.974909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:26.975345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:27.476258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:27.476723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:27.477279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 2s 18ms/step - loss: 0.1365 - val_loss: 0.1165 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1251
2023-11-26 16:59:28.155003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:28.155530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:28.156146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:28.218078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:28.218535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:28.218917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 7ms/step - loss: 0.1196 - val_loss: 0.1141 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1113 - val_loss: 0.1087 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1052 - val_loss: 0.1037 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1006 - val_loss: 0.1027 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1004 - val_loss: 0.0987 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0942 - val_loss: 0.0964 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0942 - val_loss: 0.0983 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0931 - val_loss: 0.0998 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0898 - val_loss: 0.1002 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0862 - val_loss: 0.0954 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0811 - val_loss: 0.0957 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0778 - val_loss: 0.0928 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0910 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0725 - val_loss: 0.0921 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0715 - val_loss: 0.0913 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0685 - val_loss: 0.0870 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0649 - val_loss: 0.0809 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0614 - val_loss: 0.0790 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0589 - val_loss: 0.0756 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0573 - val_loss: 0.0733 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0555 - val_loss: 0.0669 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0536 - val_loss: 0.0630 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0519 - val_loss: 0.0605 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0509 - val_loss: 0.0574 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0505 - val_loss: 0.0572 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0503 - val_loss: 0.0565 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0499 - val_loss: 0.0552 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0490 - val_loss: 0.0556 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0501 - val_loss: 0.0555 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0497 - val_loss: 0.0551 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0491 - val_loss: 0.0549 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0495 - val_loss: 0.0550 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0496 - val_loss: 0.0551 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0493 - val_loss: 0.0548 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0485 - val_loss: 0.0548 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0483 - val_loss: 0.0549 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0487 - val_loss: 0.0550 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0488 - val_loss: 0.0550 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0491 - val_loss: 0.0550 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0549 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0488 - val_loss: 0.0549 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0493 - val_loss: 0.0549 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0549 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0496 - val_loss: 0.0549 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0494 - val_loss: 0.0549 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0495 - val_loss: 0.0549 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0490 - val_loss: 0.0549 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0494 - val_loss: 0.0549 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0490 - val_loss: 0.0549 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0485 - val_loss: 0.0549 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0492 - val_loss: 0.0549 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0491 - val_loss: 0.0549 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0484 - val_loss: 0.0549 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0474 - val_loss: 0.0549 - lr: 3.7267e-09
Average Validation Loss: 0.06573698520660401
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
2023-11-26 16:59:36.891921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:36.892459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:36.892980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:36.946346: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:36.946747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:36.947108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:37.028598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:37.029085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:37.029518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:37.089405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:37.089876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:37.090290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:37.326716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:37.327182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:37.327697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:37.385514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:37.385962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:37.386369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.1120 - val_loss: 0.1358 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1094
2023-11-26 16:59:37.999889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:38.000387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:38.001059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:38.063262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:38.063717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:38.064099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.1140 - val_loss: 0.1242 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1006 - val_loss: 0.1227 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0969 - val_loss: 0.1255 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.1215 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.1298 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.1249 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.1122 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.1122 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.1214 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.1045 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.1040 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0975 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0944 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0945 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0936 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.1122 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0917 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0906 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0996 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0950 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0896 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0998 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0392 - val_loss: 0.0918 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0372 - val_loss: 0.0940 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0377 - val_loss: 0.0947 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0372 - val_loss: 0.0933 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0376 - val_loss: 0.0927 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0370 - val_loss: 0.0967 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0379 - val_loss: 0.0947 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0379 - val_loss: 0.0911 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0366 - val_loss: 0.0919 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0371 - val_loss: 0.0930 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0387 - val_loss: 0.0941 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0388 - val_loss: 0.0942 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0383 - val_loss: 0.0937 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0929 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0927 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0372 - val_loss: 0.0923 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0367 - val_loss: 0.0921 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0371 - val_loss: 0.0921 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0921 - lr: 1.1138e-06
Epoch 1/100
2023-11-26 16:59:41.620244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:41.620625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:41.620968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:41.672182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:41.672566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:41.672920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:41.755778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:41.756258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:41.756692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:41.815794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:41.816301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:41.816773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:42.010580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:42.011258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:42.011808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:42.075918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:42.076387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:42.076766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 11ms/step - loss: 0.1267 - val_loss: 0.1284 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0522
2023-11-26 16:59:42.597663: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:42.598275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:42.598684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:42.661491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:42.661957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:42.662395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1218 - val_loss: 0.0670 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1190 - val_loss: 0.0792 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1129 - val_loss: 0.0672 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1090 - val_loss: 0.0828 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1062 - val_loss: 0.0648 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1058 - val_loss: 0.0864 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1021 - val_loss: 0.0631 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1000 - val_loss: 0.0872 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0979 - val_loss: 0.0617 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0928 - val_loss: 0.0918 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0888 - val_loss: 0.0630 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0848 - val_loss: 0.0804 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0815 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.0650 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0601 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0589 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0577 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0586 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0562 - val_loss: 0.0613 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0661 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0621 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0642 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0640 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0661 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0666 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0641 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0661 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0640 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0657 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0666 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0666 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0666 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0665 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0666 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0668 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0666 - lr: 4.5166e-06
Epoch 1/100
2023-11-26 16:59:46.894351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:46.894761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:46.895257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:46.952316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:46.952721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:46.953111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:47.042096: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:47.042605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:47.043051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:47.106495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:47.107073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:47.107587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:47.347453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:47.347909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:47.348486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:47.406598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:47.407051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:47.407476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.1231 - val_loss: 0.1109 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0909
2023-11-26 16:59:48.155452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:48.156062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:48.156479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:48.221349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:48.221741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:48.222126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1095 - val_loss: 0.1009 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1076 - val_loss: 0.0991 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1024 - val_loss: 0.0916 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1020 - val_loss: 0.0905 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0997 - val_loss: 0.0888 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0952 - val_loss: 0.0871 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0955 - val_loss: 0.0857 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0909 - val_loss: 0.0813 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0877 - val_loss: 0.0817 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0851 - val_loss: 0.0752 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0796 - val_loss: 0.0740 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.0573 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0629 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0540 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0544 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0508 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0497 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0492 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0484 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0478 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0468 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0466 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0448 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0425 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0428 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0436 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0449 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0450 - val_loss: 0.0451 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0449 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0455 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0450 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0458 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0455 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0455 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0454 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0454 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0454 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0454 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0454 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0455 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0455 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0455 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0454 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0454 - lr: 3.3546e-07
Epoch 1/100
2023-11-26 16:59:56.800617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:56.800989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:56.801333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:56.859655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:56.860188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:56.860610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:56.948902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:56.949402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:56.949837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:57.014156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:57.014840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:57.015393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:57.262586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:57.263050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:57.263498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:57.322420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:57.322931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:57.323366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 8ms/step - loss: 0.1279 - val_loss: 0.1487 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1735
2023-11-26 16:59:58.119379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:58.119817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:58.120326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 16:59:58.181340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 16:59:58.181835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 16:59:58.182290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1170 - val_loss: 0.1383 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1104 - val_loss: 0.1234 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1045 - val_loss: 0.1129 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0990 - val_loss: 0.1068 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0969 - val_loss: 0.1033 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0904 - val_loss: 0.0989 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0846 - val_loss: 0.0952 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0808 - val_loss: 0.0889 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0738 - val_loss: 0.1143 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0712 - val_loss: 0.0871 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0962 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0978 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0898 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0801 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0642 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0542 - val_loss: 0.0653 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0549 - val_loss: 0.0652 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0636 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0626 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0659 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0668 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0695 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0650 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0654 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0628 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0595 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0546 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0532 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0521 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0517 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0515 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0512 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0511 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0510 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0509 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0508 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0507 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0507 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0507 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0507 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0507 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0507 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0507 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0507 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0506 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0506 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0506 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0506 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.0506 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0506 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0506 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0506 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0506 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0506 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0506 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0506 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0506 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0506 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0506 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0506 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0506 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0506 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0506 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0506 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0506 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0506 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0506 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0506 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0506 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0506 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0506 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0506 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0506 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0506 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0506 - lr: 1.1370e-14
Epoch 1/100
2023-11-26 17:00:16.944911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:16.945441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:16.945861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:17.001283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:17.001624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:17.002014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:17.083835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:17.084381: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:17.084801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:17.144922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:17.145396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:17.145811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:17.385554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:17.386278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:17.386805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:17.448415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:17.448924: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:17.449396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 1s 7ms/step - loss: 0.1196 - val_loss: 0.1026 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0400
2023-11-26 17:00:18.302175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:18.302917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:18.303403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:18.366453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:18.366929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:18.367328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 4ms/step - loss: 0.1041 - val_loss: 0.0985 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0966 - val_loss: 0.0953 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0921 - val_loss: 0.0935 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0859 - val_loss: 0.0914 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0811 - val_loss: 0.0886 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0774 - val_loss: 0.0859 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0818 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.0797 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0628 - val_loss: 0.0775 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0768 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0756 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0544 - val_loss: 0.0734 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0711 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0713 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0697 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0686 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0681 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0653 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0653 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0412 - val_loss: 0.0618 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0418 - val_loss: 0.0602 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0592 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0579 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.0571 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0364 - val_loss: 0.0568 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0563 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0367 - val_loss: 0.0557 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0558 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0557 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0367 - val_loss: 0.0549 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0546 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0544 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0543 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0542 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0359 - val_loss: 0.0542 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0542 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0364 - val_loss: 0.0542 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0542 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0355 - val_loss: 0.0542 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0355 - val_loss: 0.0542 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0358 - val_loss: 0.0542 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0364 - val_loss: 0.0542 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0542 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0542 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0542 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0361 - val_loss: 0.0542 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0542 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0362 - val_loss: 0.0542 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0360 - val_loss: 0.0542 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0358 - val_loss: 0.0542 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0361 - val_loss: 0.0542 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0359 - val_loss: 0.0542 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0359 - val_loss: 0.0542 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0355 - val_loss: 0.0542 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0542 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0358 - val_loss: 0.0542 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0542 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0353 - val_loss: 0.0542 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0542 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0363 - val_loss: 0.0542 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0362 - val_loss: 0.0542 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0542 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0542 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0542 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0358 - val_loss: 0.0542 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0347 - val_loss: 0.0542 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0542 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0355 - val_loss: 0.0542 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0362 - val_loss: 0.0542 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0361 - val_loss: 0.0542 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0354 - val_loss: 0.0542 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0542 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0358 - val_loss: 0.0542 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0542 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0359 - val_loss: 0.0542 - lr: 5.6464e-15
Average Validation Loss: 0.0589182011783123
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
2023-11-26 17:00:41.960555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:41.961236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:41.961649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:42.018948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:42.019311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:42.019658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:42.104023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:42.104497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:42.104940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:42.169992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:42.170640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:42.171089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:42.420071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:42.420567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:42.421005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:42.925066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:42.925824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:42.926275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 2s 37ms/step - loss: 0.1027 - val_loss: 0.1648 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1078
2023-11-26 17:00:43.547392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:43.547905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:43.548557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:43.608964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:43.609324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:43.609705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 7ms/step - loss: 0.1260 - val_loss: 0.1578 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1170 - val_loss: 0.1223 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1019 - val_loss: 0.1182 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0910 - val_loss: 0.1247 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0881 - val_loss: 0.1252 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0852 - val_loss: 0.1118 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0687 - val_loss: 0.1083 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0548 - val_loss: 0.1135 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0542 - val_loss: 0.1185 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0514 - val_loss: 0.1036 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.1015 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0454 - val_loss: 0.1030 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0452 - val_loss: 0.1144 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0508 - val_loss: 0.1037 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0958 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0450 - val_loss: 0.1106 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0453 - val_loss: 0.1030 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0444 - val_loss: 0.0999 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0434 - val_loss: 0.1018 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0426 - val_loss: 0.1006 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0434 - val_loss: 0.1012 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0422 - val_loss: 0.1032 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0450 - val_loss: 0.0972 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0404 - val_loss: 0.1001 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0410 - val_loss: 0.0985 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0417 - val_loss: 0.0984 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0409 - val_loss: 0.0993 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0439 - val_loss: 0.0990 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0415 - val_loss: 0.0992 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0441 - val_loss: 0.0990 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0423 - val_loss: 0.0997 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0441 - val_loss: 0.0998 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0407 - val_loss: 0.1000 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0420 - val_loss: 0.1000 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0422 - val_loss: 0.0997 - lr: 8.2297e-06
Epoch 1/100
2023-11-26 17:00:45.861027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:45.861448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:45.862082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:45.915526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:45.915966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:45.916329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:45.997832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:45.998295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:45.998732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:46.057898: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:46.058350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:46.058843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:46.243139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:46.243604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:46.244237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:46.301429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:46.301917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:46.302319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 20ms/step - loss: 0.1447 - val_loss: 0.0812 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1056
2023-11-26 17:00:46.781221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:46.781984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:46.782532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:46.845129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:46.845514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:46.845906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 5ms/step - loss: 0.1248 - val_loss: 0.0870 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1110 - val_loss: 0.0678 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1045 - val_loss: 0.0736 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1005 - val_loss: 0.0751 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0978 - val_loss: 0.0763 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0725 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0889 - val_loss: 0.0753 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.0801 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.0725 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0775 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0760 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0661 - val_loss: 0.0673 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0616 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0627 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0614 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0654 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0640 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0609 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0600 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0580 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0576 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0614 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0601 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0606 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0592 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0594 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0463 - val_loss: 0.0597 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0450 - val_loss: 0.0598 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0595 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0610 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0602 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0598 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0463 - val_loss: 0.0596 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0595 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0596 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0598 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.0598 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0597 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0596 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0596 - lr: 1.1138e-06
Epoch 1/100
2023-11-26 17:00:50.237255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:50.237666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:50.238135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:50.292474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:50.292873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:50.293247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:50.377405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:50.377827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:50.378243: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:50.437598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:50.438064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:50.438489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:50.672263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:50.672701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:50.673137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:50.731286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:50.731733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:50.732153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 15ms/step - loss: 0.1157 - val_loss: 0.1066 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0629
2023-11-26 17:00:51.390826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:51.391284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:51.391925: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:51.453244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:51.453691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:51.454074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 5ms/step - loss: 0.1063 - val_loss: 0.0938 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1034 - val_loss: 0.0873 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1000 - val_loss: 0.0833 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0961 - val_loss: 0.0799 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0789 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0934 - val_loss: 0.0775 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0751 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0714 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0696 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0612 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0614 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0669 - val_loss: 0.0540 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0639 - val_loss: 0.0567 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0652 - val_loss: 0.0601 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0548 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0551 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0550 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0573 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0562 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0566 - val_loss: 0.0628 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0655 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0661 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0629 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0615 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0632 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0609 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0609 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0609 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0611 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0608 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0613 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0607 - lr: 2.0242e-05
Epoch 1/100
2023-11-26 17:00:55.776347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:55.776785: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:55.777295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:55.829722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:55.830108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:55.830503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:55.912425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:55.912890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:55.913273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:55.974387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:55.974905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:55.975329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:56.221795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:56.222399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:56.222829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:56.282341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:56.282807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:56.283231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 13ms/step - loss: 0.1158 - val_loss: 0.1034 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0772
2023-11-26 17:00:56.993186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:56.993624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:56.994352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:00:57.057707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:00:57.058147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:00:57.058535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 5ms/step - loss: 0.1025 - val_loss: 0.1172 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0968 - val_loss: 0.1072 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0974 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0846 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0890 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0696 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0674 - val_loss: 0.0673 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0658 - val_loss: 0.0653 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0665 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0630 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0608 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0680 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0589 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0670 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0672 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0705 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0747 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0777 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0566 - val_loss: 0.0770 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0808 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0624 - val_loss: 0.0779 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0582 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0554 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.0519 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0514 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0508 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0502 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0501 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0497 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0496 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0494 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0493 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0493 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0493 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0492 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0492 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0492 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0492 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0492 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0491 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0491 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0491 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0491 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0491 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0491 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0491 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0491 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0491 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0491 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0491 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0491 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0491 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0491 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0491 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0491 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0491 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0491 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0491 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0491 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0491 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0491 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0491 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0491 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0491 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0491 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0491 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0491 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0491 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0491 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0491 - lr: 2.2897e-14
Epoch 1/100
2023-11-26 17:01:09.435498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:09.435916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:09.436384: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:09.489434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:09.489800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:09.490139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:09.571769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:09.572252: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:09.572673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:09.633129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:09.633581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:09.633989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:09.870512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:09.871059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:09.871489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:09.935116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:09.935858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:09.936355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 1s 11ms/step - loss: 0.1142 - val_loss: 0.1016 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0567
2023-11-26 17:01:10.700571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:10.701156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:10.701505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:10.765610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:10.766068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:10.766464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
43/43 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.0913 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0885 - val_loss: 0.0856 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0797 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0763 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0741 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0753 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0724 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0701 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0679 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0664 - val_loss: 0.0683 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0655 - val_loss: 0.0664 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0637 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0634 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0564 - val_loss: 0.0622 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0586 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0565 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0561 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0541 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0538 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0533 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0517 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0513 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0514 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0509 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0508 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0505 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0506 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0503 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0413 - val_loss: 0.0492 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0490 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0488 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.0488 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0393 - val_loss: 0.0488 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0489 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0394 - val_loss: 0.0489 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0394 - val_loss: 0.0489 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0489 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0489 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0396 - val_loss: 0.0489 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0489 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0489 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0393 - val_loss: 0.0489 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0489 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0489 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0489 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0391 - val_loss: 0.0489 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0392 - val_loss: 0.0489 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0391 - val_loss: 0.0489 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0396 - val_loss: 0.0489 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0394 - val_loss: 0.0489 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0489 - lr: 1.6702e-08
Average Validation Loss: 0.06107168197631836
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
2023-11-26 17:01:21.247904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:21.248329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:21.248921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:21.302933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:21.303318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:21.303668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:21.383723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:21.384208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:21.384631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:21.445038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:21.445495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:21.445930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:21.678922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:21.679398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:21.679967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:21.737833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:21.738306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:21.738725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 1s 67ms/step - loss: 0.1258 - val_loss: 0.1279 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1167
2023-11-26 17:01:22.319599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:22.320239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:22.320702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:22.381546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:22.381999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:22.382421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
5/5 [==============================] - 0s 10ms/step - loss: 0.1059 - val_loss: 0.1524 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1201 - val_loss: 0.1512 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1131 - val_loss: 0.1354 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1091 - val_loss: 0.1227 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1041 - val_loss: 0.1171 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1013 - val_loss: 0.1166 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0989 - val_loss: 0.1205 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0909 - val_loss: 0.1267 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0897 - val_loss: 0.1237 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0843 - val_loss: 0.1115 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0757 - val_loss: 0.1090 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0662 - val_loss: 0.1054 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0632 - val_loss: 0.0985 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0545 - val_loss: 0.1038 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0528 - val_loss: 0.0968 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0520 - val_loss: 0.1055 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0514 - val_loss: 0.0987 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0503 - val_loss: 0.0988 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0480 - val_loss: 0.1091 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0497 - val_loss: 0.1043 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0489 - val_loss: 0.1007 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0475 - val_loss: 0.0991 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0471 - val_loss: 0.0981 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0477 - val_loss: 0.0980 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0472 - val_loss: 0.0983 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0478 - val_loss: 0.0996 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0481 - val_loss: 0.1013 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0479 - val_loss: 0.1021 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0468 - val_loss: 0.1021 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0494 - val_loss: 0.1016 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0474 - val_loss: 0.1008 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0464 - val_loss: 0.1001 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0477 - val_loss: 0.0996 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0480 - val_loss: 0.0993 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0484 - val_loss: 0.0991 - lr: 8.2297e-06
Epoch 1/100
2023-11-26 17:01:24.189027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:24.189458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:24.190008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:24.242132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:24.242538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:24.242878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:24.325451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:24.326018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:24.326475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:24.385954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:24.386406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:24.386818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:24.639392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:24.639870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:24.640306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:25.127446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:25.128583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:25.129229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 2s 37ms/step - loss: 0.1369 - val_loss: 0.0842 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1344
2023-11-26 17:01:25.716694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:25.717157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:25.717553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:25.778562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:25.778987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:25.779372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
9/9 [==============================] - 0s 8ms/step - loss: 0.1235 - val_loss: 0.0797 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 10ms/step - loss: 0.1100 - val_loss: 0.0901 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1044 - val_loss: 0.0641 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0932 - val_loss: 0.0837 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0836 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0804 - val_loss: 0.0789 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0765 - val_loss: 0.0727 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0708 - val_loss: 0.0848 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0672 - val_loss: 0.0969 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0690 - val_loss: 0.0839 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0672 - val_loss: 0.0637 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0648 - val_loss: 0.0723 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0612 - val_loss: 0.0818 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0599 - val_loss: 0.0775 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0593 - val_loss: 0.0688 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0571 - val_loss: 0.0662 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0552 - val_loss: 0.0706 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0670 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0549 - val_loss: 0.0660 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0533 - val_loss: 0.0626 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0506 - val_loss: 0.0727 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0520 - val_loss: 0.0635 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0510 - val_loss: 0.0666 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0509 - val_loss: 0.0651 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0649 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0515 - val_loss: 0.0638 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0498 - val_loss: 0.0634 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0499 - val_loss: 0.0639 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0511 - val_loss: 0.0661 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0498 - val_loss: 0.0662 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 11ms/step - loss: 0.0493 - val_loss: 0.0654 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0488 - val_loss: 0.0640 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0516 - val_loss: 0.0639 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0487 - val_loss: 0.0633 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0496 - val_loss: 0.0633 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0486 - val_loss: 0.0637 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0505 - val_loss: 0.0636 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0495 - val_loss: 0.0637 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0505 - val_loss: 0.0637 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0493 - val_loss: 0.0636 - lr: 1.6616e-06
Epoch 1/100
2023-11-26 17:01:28.984218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:28.984672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:28.985125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:29.038576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:29.038936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:29.039284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:29.124270: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:29.124885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:29.125371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:29.188759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:29.189443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:29.189875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:29.438742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:29.439388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:29.439852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:29.499662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:29.500139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:29.500504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 1s 27ms/step - loss: 0.1326 - val_loss: 0.1135 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1421
2023-11-26 17:01:30.113176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:30.113715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:30.114368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:30.175987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:30.176379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:30.176789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
13/13 [==============================] - 0s 8ms/step - loss: 0.1143 - val_loss: 0.1229 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1012 - val_loss: 0.1040 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0956 - val_loss: 0.0971 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0896 - val_loss: 0.0865 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0856 - val_loss: 0.0787 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.0718 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0785 - val_loss: 0.0690 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0746 - val_loss: 0.0676 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0687 - val_loss: 0.0634 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0602 - val_loss: 0.0594 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0640 - val_loss: 0.0629 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0671 - val_loss: 0.0638 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0738 - val_loss: 0.0747 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0599 - val_loss: 0.0634 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0552 - val_loss: 0.0554 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0559 - val_loss: 0.0547 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0582 - val_loss: 0.0574 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0570 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0503 - val_loss: 0.0543 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0541 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0552 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0505 - val_loss: 0.0553 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0494 - val_loss: 0.0541 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0493 - val_loss: 0.0545 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0540 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0505 - val_loss: 0.0544 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0492 - val_loss: 0.0542 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0491 - val_loss: 0.0539 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0540 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0488 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0489 - val_loss: 0.0540 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0485 - val_loss: 0.0540 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0541 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0489 - val_loss: 0.0540 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0490 - val_loss: 0.0540 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0488 - val_loss: 0.0540 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0487 - val_loss: 0.0540 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0490 - val_loss: 0.0539 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0480 - val_loss: 0.0539 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0490 - val_loss: 0.0539 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0477 - val_loss: 0.0539 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0498 - val_loss: 0.0539 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0488 - val_loss: 0.0539 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0539 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0484 - val_loss: 0.0539 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0485 - val_loss: 0.0539 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0539 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0479 - val_loss: 0.0539 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0475 - val_loss: 0.0539 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0484 - val_loss: 0.0539 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0539 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0539 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0487 - val_loss: 0.0539 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0484 - val_loss: 0.0539 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0477 - val_loss: 0.0539 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0473 - val_loss: 0.0539 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0491 - val_loss: 0.0539 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0478 - val_loss: 0.0539 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0478 - val_loss: 0.0539 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0490 - val_loss: 0.0539 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0492 - val_loss: 0.0539 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0485 - val_loss: 0.0539 - lr: 5.0565e-11
Epoch 64/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0479 - val_loss: 0.0539 - lr: 2.7751e-11
Epoch 65/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0486 - val_loss: 0.0539 - lr: 1.5230e-11
Epoch 66/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0486 - val_loss: 0.0539 - lr: 8.3584e-12
Epoch 67/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0485 - val_loss: 0.0539 - lr: 4.5872e-12
Epoch 68/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0496 - val_loss: 0.0539 - lr: 2.5175e-12
Epoch 69/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0486 - val_loss: 0.0539 - lr: 1.3816e-12
Epoch 70/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0489 - val_loss: 0.0539 - lr: 7.5826e-13
Epoch 1/100
2023-11-26 17:01:37.428455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:37.428838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:37.429295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:37.486010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:37.486393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:37.486733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:37.568529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:37.569019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:37.569460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:37.628942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:37.629331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:37.629748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:37.866504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:37.866965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:37.867392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:37.927147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:37.927582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:37.928020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 1s 22ms/step - loss: 0.1237 - val_loss: 0.1105 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1330
2023-11-26 17:01:38.564570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:38.565246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:38.565705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:38.627143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:38.627595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:38.627988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
17/17 [==============================] - 0s 8ms/step - loss: 0.1068 - val_loss: 0.1001 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0960 - val_loss: 0.0968 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0893 - val_loss: 0.1033 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0877 - val_loss: 0.1247 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0960 - val_loss: 0.0774 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0770 - val_loss: 0.0804 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.1195 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0841 - val_loss: 0.1026 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0842 - val_loss: 0.0676 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0680 - val_loss: 0.0662 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0619 - val_loss: 0.0669 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0596 - val_loss: 0.0671 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0577 - val_loss: 0.0716 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0629 - val_loss: 0.0637 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0630 - val_loss: 0.0562 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0616 - val_loss: 0.0455 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0546 - val_loss: 0.0432 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0529 - val_loss: 0.0424 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0449 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0514 - val_loss: 0.0408 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0497 - val_loss: 0.0400 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0494 - val_loss: 0.0394 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0393 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0486 - val_loss: 0.0392 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0480 - val_loss: 0.0390 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0388 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0473 - val_loss: 0.0387 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0473 - val_loss: 0.0385 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0387 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0469 - val_loss: 0.0385 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0385 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0466 - val_loss: 0.0384 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0383 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0472 - val_loss: 0.0383 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0469 - val_loss: 0.0383 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0383 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0466 - val_loss: 0.0383 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0468 - val_loss: 0.0383 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0475 - val_loss: 0.0383 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0474 - val_loss: 0.0383 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0471 - val_loss: 0.0383 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0383 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0470 - val_loss: 0.0383 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0467 - val_loss: 0.0383 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0466 - val_loss: 0.0383 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0467 - val_loss: 0.0383 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0447 - val_loss: 0.0383 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0473 - val_loss: 0.0383 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0383 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0383 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0456 - val_loss: 0.0383 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0383 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0470 - val_loss: 0.0383 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0383 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0383 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0383 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0383 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0383 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0470 - val_loss: 0.0383 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0383 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0471 - val_loss: 0.0383 - lr: 9.2136e-11
Epoch 1/100
2023-11-26 17:01:46.751722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:46.752441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:46.752833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:46.807996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:46.808354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:46.808692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:46.890642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:46.891138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:46.891583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:46.952991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:46.953782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:46.954276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:47.192473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:47.193207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:47.193601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:47.253590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:47.254052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:47.254473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 1s 19ms/step - loss: 0.1160 - val_loss: 0.1027 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1021
2023-11-26 17:01:47.934183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:47.934784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:47.935410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:01:48.000354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:01:48.000850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:01:48.001275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
22/22 [==============================] - 0s 8ms/step - loss: 0.1041 - val_loss: 0.0996 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1033 - val_loss: 0.1017 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1021 - val_loss: 0.1029 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0972 - val_loss: 0.0971 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0919 - val_loss: 0.0959 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0912 - val_loss: 0.0965 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0901 - val_loss: 0.1006 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0864 - val_loss: 0.0882 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0748 - val_loss: 0.0818 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0711 - val_loss: 0.0794 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0671 - val_loss: 0.0812 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0686 - val_loss: 0.0832 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0684 - val_loss: 0.0906 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0917 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0682 - val_loss: 0.0798 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0609 - val_loss: 0.0802 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0596 - val_loss: 0.0776 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0574 - val_loss: 0.0743 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0561 - val_loss: 0.0730 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0544 - val_loss: 0.0713 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0538 - val_loss: 0.0658 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0516 - val_loss: 0.0642 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0487 - val_loss: 0.0632 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0479 - val_loss: 0.0619 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0471 - val_loss: 0.0611 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0469 - val_loss: 0.0604 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0472 - val_loss: 0.0599 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0468 - val_loss: 0.0596 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0467 - val_loss: 0.0594 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0468 - val_loss: 0.0592 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0467 - val_loss: 0.0591 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0590 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0468 - val_loss: 0.0589 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0588 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0588 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0588 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0462 - val_loss: 0.0587 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0467 - val_loss: 0.0587 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0587 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0456 - val_loss: 0.0587 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0475 - val_loss: 0.0587 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0587 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0587 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0454 - val_loss: 0.0587 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0587 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0587 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0451 - val_loss: 0.0587 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0587 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0587 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0587 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0587 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0587 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0454 - val_loss: 0.0587 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0587 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0587 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0587 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0587 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0587 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0587 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0587 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0455 - val_loss: 0.0587 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0587 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0451 - val_loss: 0.0587 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0587 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0457 - val_loss: 0.0587 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0587 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0468 - val_loss: 0.0587 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0587 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0587 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0454 - val_loss: 0.0587 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0455 - val_loss: 0.0587 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0587 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0587 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0587 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0453 - val_loss: 0.0587 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0456 - val_loss: 0.0587 - lr: 5.6464e-15
Epoch 78/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0587 - lr: 2.8039e-15
Epoch 79/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0457 - val_loss: 0.0587 - lr: 1.3924e-15
Epoch 80/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0587 - lr: 6.9144e-16
Average Validation Loss: 0.062065234035253526
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Epoch 1/100
2023-11-26 17:02:00.896313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:02:00.896883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:02:00.897530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:02:00.957255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:02:00.957622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:02:00.957991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:02:01.056166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:02:01.056979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:02:01.057789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:02:01.126115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:02:01.126749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:02:01.127329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:02:01.381717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:02:01.382160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:02:01.382794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 17:02:01.442309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 17:02:01.442726: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 17:02:01.443164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
 97/102 [===========================>..] - ETA: 0s - loss: 0.1222WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 1s 4ms/step - loss: 0.1225 - lr: 0.0010
Epoch 2/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.1066WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.1070 - lr: 0.0010
Epoch 3/100
 97/102 [===========================>..] - ETA: 0s - loss: 0.0979WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0987 - lr: 0.0010
Epoch 4/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0875WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0893 - lr: 0.0010
Epoch 5/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0833WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0849 - lr: 0.0010
Epoch 6/100
 96/102 [===========================>..] - ETA: 0s - loss: 0.0785WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0801 - lr: 0.0010
Epoch 7/100
 96/102 [===========================>..] - ETA: 0s - loss: 0.0734WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0746 - lr: 0.0010
Epoch 8/100
 96/102 [===========================>..] - ETA: 0s - loss: 0.0680WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0692 - lr: 0.0010
Epoch 9/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0661WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0665 - lr: 0.0010
Epoch 10/100
100/102 [============================>.] - ETA: 0s - loss: 0.0646WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0659 - lr: 0.0010
Epoch 11/100
 92/102 [==========================>...] - ETA: 0s - loss: 0.0615WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0617 - lr: 9.0484e-04
Epoch 12/100
 93/102 [==========================>...] - ETA: 0s - loss: 0.0599WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0599 - lr: 8.1873e-04
Epoch 13/100
100/102 [============================>.] - ETA: 0s - loss: 0.0535WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0542 - lr: 7.4082e-04
Epoch 14/100
102/102 [==============================] - ETA: 0s - loss: 0.0520WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0520 - lr: 6.7032e-04
Epoch 15/100
101/102 [============================>.] - ETA: 0s - loss: 0.0485WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0488 - lr: 6.0653e-04
Epoch 16/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0438WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0449 - lr: 5.4881e-04
Epoch 17/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0404WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0422 - lr: 4.9659e-04
Epoch 18/100
100/102 [============================>.] - ETA: 0s - loss: 0.0415WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0421 - lr: 4.4933e-04
Epoch 19/100
101/102 [============================>.] - ETA: 0s - loss: 0.0401WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0405 - lr: 4.0657e-04
Epoch 20/100
101/102 [============================>.] - ETA: 0s - loss: 0.0390WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0394 - lr: 3.6788e-04
Epoch 21/100
101/102 [============================>.] - ETA: 0s - loss: 0.0372WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0376 - lr: 3.0119e-04
Epoch 22/100
101/102 [============================>.] - ETA: 0s - loss: 0.0370WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0374 - lr: 2.4660e-04
Epoch 23/100
100/102 [============================>.] - ETA: 0s - loss: 0.0356WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0364 - lr: 2.0190e-04
Epoch 24/100
100/102 [============================>.] - ETA: 0s - loss: 0.0343WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0351 - lr: 1.6530e-04
Epoch 25/100
 88/102 [========================>.....] - ETA: 0s - loss: 0.0338WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0341 - lr: 1.3534e-04
Epoch 26/100
101/102 [============================>.] - ETA: 0s - loss: 0.0327WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0332 - lr: 1.1080e-04
Epoch 27/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0322WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0331 - lr: 9.0718e-05
Epoch 28/100
102/102 [==============================] - ETA: 0s - loss: 0.0324WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0324 - lr: 7.4274e-05
Epoch 29/100
 91/102 [=========================>....] - ETA: 0s - loss: 0.0317WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0322 - lr: 6.0810e-05
Epoch 30/100
 93/102 [==========================>...] - ETA: 0s - loss: 0.0318WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0321 - lr: 4.9787e-05
Epoch 31/100
 91/102 [=========================>....] - ETA: 0s - loss: 0.0316WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0319 - lr: 3.6883e-05
Epoch 32/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0316WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0323 - lr: 2.7324e-05
Epoch 33/100
 93/102 [==========================>...] - ETA: 0s - loss: 0.0317WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0320 - lr: 2.0242e-05
Epoch 34/100
101/102 [============================>.] - ETA: 0s - loss: 0.0313WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0318 - lr: 1.4996e-05
Epoch 35/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0313 - lr: 1.1109e-05
Epoch 36/100
 94/102 [==========================>...] - ETA: 0s - loss: 0.0313WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0318 - lr: 8.2297e-06
Epoch 37/100
102/102 [==============================] - ETA: 0s - loss: 0.0315WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0315 - lr: 6.0967e-06
Epoch 38/100
 92/102 [==========================>...] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0315 - lr: 4.5166e-06
Epoch 39/100
102/102 [==============================] - ETA: 0s - loss: 0.0314WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0314 - lr: 3.3460e-06
Epoch 40/100
100/102 [============================>.] - ETA: 0s - loss: 0.0307WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0314 - lr: 2.4788e-06
Epoch 41/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0307WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0311 - lr: 1.6616e-06
Epoch 42/100
 91/102 [=========================>....] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0315 - lr: 1.1138e-06
Epoch 43/100
 96/102 [===========================>..] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0318 - lr: 7.4659e-07
Epoch 44/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0309WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0317 - lr: 5.0045e-07
Epoch 45/100
101/102 [============================>.] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0314 - lr: 3.3546e-07
Epoch 46/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0313WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0316 - lr: 2.2487e-07
Epoch 47/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0319 - lr: 1.5073e-07
Epoch 48/100
102/102 [==============================] - ETA: 0s - loss: 0.0314WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0314 - lr: 1.0104e-07
Epoch 49/100
102/102 [==============================] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0311 - lr: 6.7729e-08
Epoch 50/100
 94/102 [==========================>...] - ETA: 0s - loss: 0.0303WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0310 - lr: 4.5400e-08
Epoch 51/100
 94/102 [==========================>...] - ETA: 0s - loss: 0.0308WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0313 - lr: 2.7536e-08
Epoch 52/100
 92/102 [==========================>...] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0315 - lr: 1.6702e-08
Epoch 53/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0315 - lr: 1.0130e-08
Epoch 54/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0314 - lr: 6.1442e-09
Epoch 55/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0316 - lr: 3.7267e-09
Epoch 56/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0316 - lr: 2.2603e-09
Epoch 57/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0315 - lr: 1.3710e-09
Epoch 58/100
 92/102 [==========================>...] - ETA: 0s - loss: 0.0307WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0312 - lr: 8.3153e-10
Epoch 59/100
 92/102 [==========================>...] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0315 - lr: 5.0435e-10
Epoch 60/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0308WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0311 - lr: 3.0590e-10
Epoch 61/100
102/102 [==============================] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0310 - lr: 1.6788e-10
Epoch 62/100
100/102 [============================>.] - ETA: 0s - loss: 0.0305WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0313 - lr: 9.2136e-11
Epoch 63/100
101/102 [============================>.] - ETA: 0s - loss: 0.0309WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0313 - lr: 5.0565e-11
Epoch 64/100
100/102 [============================>.] - ETA: 0s - loss: 0.0304WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0312 - lr: 2.7751e-11
Epoch 65/100
102/102 [==============================] - ETA: 0s - loss: 0.0316WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0316 - lr: 1.5230e-11
Epoch 66/100
101/102 [============================>.] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0316 - lr: 8.3584e-12
Epoch 67/100
100/102 [============================>.] - ETA: 0s - loss: 0.0303WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0310 - lr: 4.5872e-12
Epoch 68/100
101/102 [============================>.] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0315 - lr: 2.5175e-12
Epoch 69/100
100/102 [============================>.] - ETA: 0s - loss: 0.0309WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0318 - lr: 1.3816e-12
Epoch 70/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0307WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0316 - lr: 7.5826e-13
Epoch 71/100
102/102 [==============================] - ETA: 0s - loss: 0.0313WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0313 - lr: 3.7654e-13
Epoch 72/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0314 - lr: 1.8698e-13
Epoch 73/100
102/102 [==============================] - ETA: 0s - loss: 0.0317WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0317 - lr: 9.2853e-14
Epoch 74/100
101/102 [============================>.] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0317 - lr: 4.6110e-14
Epoch 75/100
100/102 [============================>.] - ETA: 0s - loss: 0.0308WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0315 - lr: 2.2897e-14
Epoch 76/100
102/102 [==============================] - ETA: 0s - loss: 0.0313WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0313 - lr: 1.1370e-14
Epoch 77/100
100/102 [============================>.] - ETA: 0s - loss: 0.0302WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0310 - lr: 5.6464e-15
Epoch 78/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0314 - lr: 2.8039e-15
Epoch 79/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0315 - lr: 1.3924e-15
Epoch 80/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0303WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0312 - lr: 6.9144e-16
Epoch 81/100
102/102 [==============================] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0312 - lr: 3.1068e-16
Epoch 82/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0305WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0315 - lr: 1.3960e-16
Epoch 83/100
102/102 [==============================] - ETA: 0s - loss: 0.0315WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0315 - lr: 6.2726e-17
Epoch 84/100
 98/102 [===========================>..] - ETA: 0s - loss: 0.0305WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0313 - lr: 2.8185e-17
Epoch 85/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0309WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0312 - lr: 1.2664e-17
Epoch 86/100
 91/102 [=========================>....] - ETA: 0s - loss: 0.0313WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0316 - lr: 5.6904e-18
Epoch 87/100
 96/102 [===========================>..] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0317 - lr: 2.5569e-18
Epoch 88/100
 93/102 [==========================>...] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0316 - lr: 1.1489e-18
Epoch 89/100
 91/102 [=========================>....] - ETA: 0s - loss: 0.0308WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0313 - lr: 5.1622e-19
Epoch 90/100
 99/102 [============================>.] - ETA: 0s - loss: 0.0306WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0314 - lr: 2.3195e-19
Epoch 91/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0319 - lr: 9.4305e-20
Epoch 92/100
 88/102 [========================>.....] - ETA: 0s - loss: 0.0315WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0316 - lr: 3.8341e-20
Epoch 93/100
 89/102 [=========================>....] - ETA: 0s - loss: 0.0309WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 4ms/step - loss: 0.0312 - lr: 1.5588e-20
Epoch 94/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0311WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0319 - lr: 6.3378e-21
Epoch 95/100
 90/102 [=========================>....] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0312 - lr: 2.5768e-21
Epoch 96/100
 92/102 [==========================>...] - ETA: 0s - loss: 0.0310WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0312 - lr: 1.0476e-21
Epoch 97/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0314WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0319 - lr: 4.2594e-22
Epoch 98/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0304WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0310 - lr: 1.7317e-22
Epoch 99/100
 94/102 [==========================>...] - ETA: 0s - loss: 0.0312WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0317 - lr: 7.0407e-23
Epoch 100/100
 95/102 [==========================>...] - ETA: 0s - loss: 0.0305WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
102/102 [==============================] - 0s 3ms/step - loss: 0.0311 - lr: 2.8625e-23
<keras.callbacks.History at 0x3049c5b90>

1.3.6.3 3. Model Performance

While this model did not perform as well as many of the other five models developed, I still was able to achieve significant improvement in it. One can see that the LSTM Initial Models had much higher RMSEs and that I saw significant improvements after using the MinMaxScaler(), using forwards and backwards fill for imputation, and implementing cross-validation.

Furthermore, the graphs comparing the predictions to the actual values seem to make much more sense after implementing these changes. Before, it was difficult to understand why the graphs were such odd shapes, but the final graphs reflect a pattern similar to that of the XGBoost model developed using ungrouped data.

The final final metrics obtained were:

Training Metrics: MAE: 0.019462694273006197, RMSE: 0.030340060238547382, Training R-squared: 0.9538018193299438

Testing Metrics: MAE: 0.03335198051308351, RMSE: 0.045407351521714524, Testing R-squared: 0.8868747184643261

Code
# Make predictions with the trained model
train_pred = model_final.predict(X_train)
test_pred = model_final.predict(X_test)

# Calculate R-squared for training and testing sets
train_r2 = r2_score(y_train, train_pred)
test_r2 = r2_score(y_test, test_pred)

# Calculate and print performance metrics
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
print(f"Training Metrics: MAE: {mean_absolute_error(y_train, train_pred)}, RMSE: {train_rmse}, Training R-squared: {train_r2}")
print(f"Testing Metrics: MAE: {mean_absolute_error(y_test, test_pred)}, RMSE: {test_rmse}, Testing R-squared: {test_r2}")
102/102 [==============================] - 0s 912us/step
34/34 [==============================] - 0s 852us/step
Training Metrics: MAE: 0.019462694273006197, RMSE: 0.030340060238547382, Training R-squared: 0.9538018193299438
Testing Metrics: MAE: 0.03335198051308351, RMSE: 0.045407351521714524, Testing R-squared: 0.8868747184643261
Epoch 10/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1194 - val_loss: 0.1136 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1135 - val_loss: 0.1020 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1072 - val_loss: 0.1052 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1049 - val_loss: 0.0998 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1004 - val_loss: 0.0981 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0982 - val_loss: 0.0990 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0975 - val_loss: 0.0940 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0951 - val_loss: 0.0965 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0952 - val_loss: 0.0917 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0905 - val_loss: 0.0918 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0906 - val_loss: 0.0917 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0898 - val_loss: 0.0926 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0882 - val_loss: 0.0915 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0869 - val_loss: 0.0892 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0869 - val_loss: 0.0900 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0863 - val_loss: 0.0901 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0872 - val_loss: 0.0900 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 1s 97ms/step - loss: 0.0868 - val_loss: 0.0896 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 1s 70ms/step - loss: 0.0861 - val_loss: 0.0894 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 46ms/step - loss: 0.0850 - val_loss: 0.0896 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0835 - val_loss: 0.0901 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0856 - val_loss: 0.0897 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0851 - val_loss: 0.0890 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0865 - val_loss: 0.0887 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0856 - val_loss: 0.0888 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0846 - val_loss: 0.0889 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 51ms/step - loss: 0.0851 - val_loss: 0.0890 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0853 - val_loss: 0.0890 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0851 - val_loss: 0.0891 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0851 - val_loss: 0.0892 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0841 - val_loss: 0.0892 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0830 - val_loss: 0.0893 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0860 - val_loss: 0.0893 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0848 - val_loss: 0.0893 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0846 - val_loss: 0.0893 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0850 - val_loss: 0.0893 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 49ms/step - loss: 0.0849 - val_loss: 0.0893 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0850 - val_loss: 0.0893 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0853 - val_loss: 0.0893 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0849 - val_loss: 0.0893 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0851 - val_loss: 0.0893 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0842 - val_loss: 0.0893 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0851 - val_loss: 0.0893 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0853 - val_loss: 0.0893 - lr: 1.0130e-08
Epoch 1/100
13/13 [==============================] - 6s 140ms/step - loss: 0.2389 - val_loss: 0.2086 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1625 - val_loss: 0.1706 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1530 - val_loss: 0.1605 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1456 - val_loss: 0.1543 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1358 - val_loss: 0.1422 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1343 - val_loss: 0.1364 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1265 - val_loss: 0.1310 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1220 - val_loss: 0.1216 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1179 - val_loss: 0.1128 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1134 - val_loss: 0.1059 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1074 - val_loss: 0.0997 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1063 - val_loss: 0.0959 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1040 - val_loss: 0.0958 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0975 - val_loss: 0.0927 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0947 - val_loss: 0.0873 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0931 - val_loss: 0.0858 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0938 - val_loss: 0.0879 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0923 - val_loss: 0.0870 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0874 - val_loss: 0.0811 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0868 - val_loss: 0.0822 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0866 - val_loss: 0.0847 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0834 - val_loss: 0.0798 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0853 - val_loss: 0.0829 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0836 - val_loss: 0.0809 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0829 - val_loss: 0.0797 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0844 - val_loss: 0.0832 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0828 - val_loss: 0.0818 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0828 - val_loss: 0.0798 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0825 - val_loss: 0.0798 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0813 - val_loss: 0.0810 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0812 - val_loss: 0.0806 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0817 - val_loss: 0.0800 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0810 - val_loss: 0.0804 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0814 - val_loss: 0.0805 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0819 - val_loss: 0.0807 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0813 - val_loss: 0.0807 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0805 - val_loss: 0.0807 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0806 - val_loss: 0.0806 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0817 - val_loss: 0.0807 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0811 - val_loss: 0.0807 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0806 - val_loss: 0.0806 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0803 - val_loss: 0.0806 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0810 - val_loss: 0.0806 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0801 - val_loss: 0.0806 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0814 - val_loss: 0.0806 - lr: 3.3546e-07
Epoch 1/100
17/17 [==============================] - 5s 71ms/step - loss: 0.1742 - val_loss: 0.1613 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1637 - val_loss: 0.1477 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1487 - val_loss: 0.1430 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1422 - val_loss: 0.1311 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1296 - val_loss: 0.1401 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1266 - val_loss: 0.1357 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1232 - val_loss: 0.1203 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1125 - val_loss: 0.1204 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1080 - val_loss: 0.1282 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1063 - val_loss: 0.1233 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1045 - val_loss: 0.1018 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0952 - val_loss: 0.0990 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0910 - val_loss: 0.0935 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0874 - val_loss: 0.0931 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0865 - val_loss: 0.0836 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0818 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0811 - val_loss: 0.0764 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0791 - val_loss: 0.0787 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0800 - val_loss: 0.0758 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0807 - val_loss: 0.0655 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0767 - val_loss: 0.0635 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0744 - val_loss: 0.0617 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0733 - val_loss: 0.0627 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0737 - val_loss: 0.0611 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0727 - val_loss: 0.0613 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0716 - val_loss: 0.0608 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0716 - val_loss: 0.0604 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0717 - val_loss: 0.0606 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0725 - val_loss: 0.0604 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0723 - val_loss: 0.0608 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0726 - val_loss: 0.0604 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0714 - val_loss: 0.0604 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0604 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0722 - val_loss: 0.0605 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0720 - val_loss: 0.0603 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0713 - val_loss: 0.0602 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0715 - val_loss: 0.0602 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0718 - val_loss: 0.0602 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0719 - val_loss: 0.0602 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0714 - val_loss: 0.0602 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0719 - val_loss: 0.0602 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0722 - val_loss: 0.0602 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0712 - val_loss: 0.0602 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0721 - val_loss: 0.0602 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0716 - val_loss: 0.0602 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0719 - val_loss: 0.0602 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0723 - val_loss: 0.0602 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0713 - val_loss: 0.0602 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0724 - val_loss: 0.0602 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0715 - val_loss: 0.0602 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0717 - val_loss: 0.0602 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0719 - val_loss: 0.0602 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0716 - val_loss: 0.0602 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0710 - val_loss: 0.0602 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0715 - val_loss: 0.0602 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0717 - val_loss: 0.0602 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0718 - val_loss: 0.0602 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0718 - val_loss: 0.0602 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0715 - val_loss: 0.0602 - lr: 5.0435e-10
Epoch 1/100
22/22 [==============================] - 4s 63ms/step - loss: 0.2102 - val_loss: 0.1557 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 20ms/step - loss: 0.1630 - val_loss: 0.1476 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1477 - val_loss: 0.1361 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1322 - val_loss: 0.1229 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1238 - val_loss: 0.1233 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1204 - val_loss: 0.1240 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1187 - val_loss: 0.1276 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1148 - val_loss: 0.1166 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1105 - val_loss: 0.1145 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 21ms/step - loss: 0.1078 - val_loss: 0.1160 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1061 - val_loss: 0.1119 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0989 - val_loss: 0.1027 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0962 - val_loss: 0.1064 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0969 - val_loss: 0.1047 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0935 - val_loss: 0.1002 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0900 - val_loss: 0.0959 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0865 - val_loss: 0.0963 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0859 - val_loss: 0.0934 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0827 - val_loss: 0.0916 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0813 - val_loss: 0.0899 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0799 - val_loss: 0.0861 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0781 - val_loss: 0.0851 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0767 - val_loss: 0.0836 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0766 - val_loss: 0.0819 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0750 - val_loss: 0.0808 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0747 - val_loss: 0.0803 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0742 - val_loss: 0.0797 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0744 - val_loss: 0.0794 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0742 - val_loss: 0.0789 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0735 - val_loss: 0.0785 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0738 - val_loss: 0.0781 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0727 - val_loss: 0.0781 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0729 - val_loss: 0.0781 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0735 - val_loss: 0.0782 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0736 - val_loss: 0.0781 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0727 - val_loss: 0.0781 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0733 - val_loss: 0.0781 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0734 - val_loss: 0.0780 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0727 - val_loss: 0.0780 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0729 - val_loss: 0.0779 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0725 - val_loss: 0.0779 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0732 - val_loss: 0.0779 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0723 - val_loss: 0.0779 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0724 - val_loss: 0.0779 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0721 - val_loss: 0.0779 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0726 - val_loss: 0.0779 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0723 - val_loss: 0.0779 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0729 - val_loss: 0.0779 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0725 - val_loss: 0.0779 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0720 - val_loss: 0.0779 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0733 - val_loss: 0.0779 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0730 - val_loss: 0.0779 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0727 - val_loss: 0.0779 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0722 - val_loss: 0.0779 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0731 - val_loss: 0.0779 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0723 - val_loss: 0.0779 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0730 - val_loss: 0.0779 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0725 - val_loss: 0.0779 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0731 - val_loss: 0.0779 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0720 - val_loss: 0.0779 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0724 - val_loss: 0.0779 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0727 - val_loss: 0.0779 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0721 - val_loss: 0.0779 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0725 - val_loss: 0.0779 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0722 - val_loss: 0.0779 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0779 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0779 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0730 - val_loss: 0.0779 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0715 - val_loss: 0.0779 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0733 - val_loss: 0.0779 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0719 - val_loss: 0.0779 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0725 - val_loss: 0.0779 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0728 - val_loss: 0.0779 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0729 - val_loss: 0.0779 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0727 - val_loss: 0.0779 - lr: 2.2897e-14
Average Validation Loss: 0.0886541835963726
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 65ms/step - loss: 0.1725 - val_loss: 0.1339 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1133 - val_loss: 0.1320 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1099 - val_loss: 0.1276 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1050 - val_loss: 0.1272 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1039 - val_loss: 0.1239 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1022 - val_loss: 0.1222 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0920 - val_loss: 0.1223 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0953 - val_loss: 0.1158 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0751 - val_loss: 0.1288 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0866 - val_loss: 0.1279 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0924 - val_loss: 0.1130 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0652 - val_loss: 0.1132 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0603 - val_loss: 0.1116 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0594 - val_loss: 0.1042 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0548 - val_loss: 0.1001 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0510 - val_loss: 0.1000 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0492 - val_loss: 0.0983 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0553 - val_loss: 0.1181 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0496 - val_loss: 0.1107 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0489 - val_loss: 0.0968 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0449 - val_loss: 0.1122 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0478 - val_loss: 0.1051 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0454 - val_loss: 0.1117 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0456 - val_loss: 0.0991 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0469 - val_loss: 0.1049 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0452 - val_loss: 0.1092 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0461 - val_loss: 0.1008 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0425 - val_loss: 0.1085 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0460 - val_loss: 0.1026 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0438 - val_loss: 0.1046 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0437 - val_loss: 0.1019 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0439 - val_loss: 0.1003 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0440 - val_loss: 0.1018 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0436 - val_loss: 0.1013 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0430 - val_loss: 0.1020 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0443 - val_loss: 0.1013 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0431 - val_loss: 0.1012 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0423 - val_loss: 0.1015 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0429 - val_loss: 0.1018 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0434 - val_loss: 0.1019 - lr: 2.4788e-06
Epoch 1/100
34/34 [==============================] - 5s 38ms/step - loss: 0.1674 - val_loss: 0.0861 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1271 - val_loss: 0.0874 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1228 - val_loss: 0.0794 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1209 - val_loss: 0.0779 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1182 - val_loss: 0.0741 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1151 - val_loss: 0.0745 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1136 - val_loss: 0.0714 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1110 - val_loss: 0.0748 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1111 - val_loss: 0.0717 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1090 - val_loss: 0.0735 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1048 - val_loss: 0.0786 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0983 - val_loss: 0.0746 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1001 - val_loss: 0.0709 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0926 - val_loss: 0.0827 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0905 - val_loss: 0.0742 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0846 - val_loss: 0.0789 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0807 - val_loss: 0.0773 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0776 - val_loss: 0.0772 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0737 - val_loss: 0.0796 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0709 - val_loss: 0.0744 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0720 - val_loss: 0.0690 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0690 - val_loss: 0.0712 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0653 - val_loss: 0.0745 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0650 - val_loss: 0.0759 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0638 - val_loss: 0.0757 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0626 - val_loss: 0.0785 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0773 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0619 - val_loss: 0.0763 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0785 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0606 - val_loss: 0.0777 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0618 - val_loss: 0.0790 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0602 - val_loss: 0.0786 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0601 - val_loss: 0.0787 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0607 - val_loss: 0.0788 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0607 - val_loss: 0.0791 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0601 - val_loss: 0.0790 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0611 - val_loss: 0.0785 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0598 - val_loss: 0.0781 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0612 - val_loss: 0.0783 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0784 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0610 - val_loss: 0.0785 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 5s 32ms/step - loss: 0.1204 - val_loss: 0.1086 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1083 - val_loss: 0.0994 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1022 - val_loss: 0.0925 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0991 - val_loss: 0.0886 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0974 - val_loss: 0.0893 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0901 - val_loss: 0.0833 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0924 - val_loss: 0.0862 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0848 - val_loss: 0.0822 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0820 - val_loss: 0.0818 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0793 - val_loss: 0.0737 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0750 - val_loss: 0.0726 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0692 - val_loss: 0.0688 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0640 - val_loss: 0.0646 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0621 - val_loss: 0.0637 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0635 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0575 - val_loss: 0.0598 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0551 - val_loss: 0.0597 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0550 - val_loss: 0.0614 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0543 - val_loss: 0.0591 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0527 - val_loss: 0.0595 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0527 - val_loss: 0.0612 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0557 - val_loss: 0.0600 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0564 - val_loss: 0.0552 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0524 - val_loss: 0.0533 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0527 - val_loss: 0.0524 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0514 - val_loss: 0.0519 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0507 - val_loss: 0.0514 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0495 - val_loss: 0.0512 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0498 - val_loss: 0.0511 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0484 - val_loss: 0.0511 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0485 - val_loss: 0.0510 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0488 - val_loss: 0.0508 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0476 - val_loss: 0.0507 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0482 - val_loss: 0.0507 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0476 - val_loss: 0.0507 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0481 - val_loss: 0.0507 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0507 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0507 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0507 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0507 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0468 - val_loss: 0.0507 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0468 - val_loss: 0.0507 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0507 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0465 - val_loss: 0.0507 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0507 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0507 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0507 - lr: 1.6702e-08
Epoch 53/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 1.0130e-08
Epoch 54/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0470 - val_loss: 0.0507 - lr: 6.1442e-09
Epoch 55/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0507 - lr: 3.7267e-09
Epoch 56/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0478 - val_loss: 0.0507 - lr: 2.2603e-09
Epoch 57/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0474 - val_loss: 0.0507 - lr: 1.3710e-09
Epoch 1/100
68/68 [==============================] - 5s 26ms/step - loss: 0.1279 - val_loss: 0.1179 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1153 - val_loss: 0.1186 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1097 - val_loss: 0.1163 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1065 - val_loss: 0.1209 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1016 - val_loss: 0.1153 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0981 - val_loss: 0.1016 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0920 - val_loss: 0.0989 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0804 - val_loss: 0.1226 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0749 - val_loss: 0.1520 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0748 - val_loss: 0.1265 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0685 - val_loss: 0.1053 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0646 - val_loss: 0.0872 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0628 - val_loss: 0.0830 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0607 - val_loss: 0.0747 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0620 - val_loss: 0.0643 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0578 - val_loss: 0.0622 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0552 - val_loss: 0.0625 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0547 - val_loss: 0.0605 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0530 - val_loss: 0.0578 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0512 - val_loss: 0.0589 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0500 - val_loss: 0.0585 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0500 - val_loss: 0.0638 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0491 - val_loss: 0.0634 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0501 - val_loss: 0.0639 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0505 - val_loss: 0.0581 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0492 - val_loss: 0.0584 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0496 - val_loss: 0.0558 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0501 - val_loss: 0.0526 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0494 - val_loss: 0.0493 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0486 - val_loss: 0.0478 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0487 - val_loss: 0.0476 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0477 - val_loss: 0.0474 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0467 - val_loss: 0.0472 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0460 - val_loss: 0.0469 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0468 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0464 - val_loss: 0.0469 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0468 - val_loss: 0.0469 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0468 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0463 - val_loss: 0.0468 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0467 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0460 - val_loss: 0.0467 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0458 - val_loss: 0.0467 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0459 - val_loss: 0.0467 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0457 - val_loss: 0.0466 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0463 - val_loss: 0.0466 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0469 - val_loss: 0.0466 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0466 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0465 - val_loss: 0.0466 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0467 - val_loss: 0.0466 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0466 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0466 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0466 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0458 - val_loss: 0.0466 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0466 - val_loss: 0.0466 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0466 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0464 - val_loss: 0.0466 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0466 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0459 - val_loss: 0.0466 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0465 - val_loss: 0.0466 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0468 - val_loss: 0.0466 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0466 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0466 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0464 - val_loss: 0.0466 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0468 - val_loss: 0.0466 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0466 - val_loss: 0.0466 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0457 - val_loss: 0.0466 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0455 - val_loss: 0.0466 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0466 - val_loss: 0.0466 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0466 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0464 - val_loss: 0.0466 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0454 - val_loss: 0.0466 - lr: 3.1068e-16
Epoch 1/100
85/85 [==============================] - 7s 48ms/step - loss: 0.1247 - val_loss: 0.1051 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 20ms/step - loss: 0.1090 - val_loss: 0.0986 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0993 - val_loss: 0.0959 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0933 - val_loss: 0.0948 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 3s 31ms/step - loss: 0.0919 - val_loss: 0.0919 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 3s 33ms/step - loss: 0.0861 - val_loss: 0.0898 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0836 - val_loss: 0.0891 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0790 - val_loss: 0.0859 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0757 - val_loss: 0.0806 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0654 - val_loss: 0.0789 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0658 - val_loss: 0.0742 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0621 - val_loss: 0.0726 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0581 - val_loss: 0.0680 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0592 - val_loss: 0.0668 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0573 - val_loss: 0.0635 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0553 - val_loss: 0.0638 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0541 - val_loss: 0.0608 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0536 - val_loss: 0.0606 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0518 - val_loss: 0.0583 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0579 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0568 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0475 - val_loss: 0.0581 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0452 - val_loss: 0.0576 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0446 - val_loss: 0.0564 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0440 - val_loss: 0.0568 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0438 - val_loss: 0.0569 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0430 - val_loss: 0.0578 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0433 - val_loss: 0.0568 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0427 - val_loss: 0.0563 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0421 - val_loss: 0.0556 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0420 - val_loss: 0.0557 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0413 - val_loss: 0.0557 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0414 - val_loss: 0.0553 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0418 - val_loss: 0.0551 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0410 - val_loss: 0.0550 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0409 - val_loss: 0.0549 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0405 - val_loss: 0.0548 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0414 - val_loss: 0.0548 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0404 - val_loss: 0.0548 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0403 - val_loss: 0.0548 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0407 - val_loss: 0.0548 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0414 - val_loss: 0.0548 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0404 - val_loss: 0.0548 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0414 - val_loss: 0.0548 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0409 - val_loss: 0.0548 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0400 - val_loss: 0.0548 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0416 - val_loss: 0.0548 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0409 - val_loss: 0.0548 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0408 - val_loss: 0.0548 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0421 - val_loss: 0.0548 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0405 - val_loss: 0.0548 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0410 - val_loss: 0.0548 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0410 - val_loss: 0.0548 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0410 - val_loss: 0.0548 - lr: 8.3153e-10
Average Validation Loss: 0.06358843743801117
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 5s 125ms/step - loss: 0.2039 - val_loss: 0.1432 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1072 - val_loss: 0.1437 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1117 - val_loss: 0.1482 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1136 - val_loss: 0.1394 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1070 - val_loss: 0.1306 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1004 - val_loss: 0.1271 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0995 - val_loss: 0.1270 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0937 - val_loss: 0.1281 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0921 - val_loss: 0.1290 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0898 - val_loss: 0.1253 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0864 - val_loss: 0.1241 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0822 - val_loss: 0.1175 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0774 - val_loss: 0.1166 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0728 - val_loss: 0.1152 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0716 - val_loss: 0.1103 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0623 - val_loss: 0.1144 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0655 - val_loss: 0.1074 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0580 - val_loss: 0.1082 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0560 - val_loss: 0.1048 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0542 - val_loss: 0.1022 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0523 - val_loss: 0.1046 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0519 - val_loss: 0.1047 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0500 - val_loss: 0.1055 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0515 - val_loss: 0.1034 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0502 - val_loss: 0.1015 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0503 - val_loss: 0.1015 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0482 - val_loss: 0.1013 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0510 - val_loss: 0.1007 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0494 - val_loss: 0.1004 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0487 - val_loss: 0.1001 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0499 - val_loss: 0.1004 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0492 - val_loss: 0.1003 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0503 - val_loss: 0.1003 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 1s 65ms/step - loss: 0.0492 - val_loss: 0.1003 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0506 - val_loss: 0.1003 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0491 - val_loss: 0.1005 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0513 - val_loss: 0.1006 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0499 - val_loss: 0.1006 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0480 - val_loss: 0.1005 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0489 - val_loss: 0.1005 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0507 - val_loss: 0.1005 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0505 - val_loss: 0.1005 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0483 - val_loss: 0.1005 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0501 - val_loss: 0.1005 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0503 - val_loss: 0.1005 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0497 - val_loss: 0.1004 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0497 - val_loss: 0.1004 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0499 - val_loss: 0.1004 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0497 - val_loss: 0.1004 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0486 - val_loss: 0.1004 - lr: 4.5400e-08
Epoch 1/100
17/17 [==============================] - 4s 62ms/step - loss: 0.1562 - val_loss: 0.0933 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1245 - val_loss: 0.0856 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1214 - val_loss: 0.0818 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1184 - val_loss: 0.0784 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1131 - val_loss: 0.0730 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1055 - val_loss: 0.0666 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0992 - val_loss: 0.0626 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0913 - val_loss: 0.0617 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0865 - val_loss: 0.0586 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0823 - val_loss: 0.0653 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0743 - val_loss: 0.0639 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0695 - val_loss: 0.0560 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0673 - val_loss: 0.0527 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0672 - val_loss: 0.0500 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0744 - val_loss: 0.0618 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0640 - val_loss: 0.0794 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0603 - val_loss: 0.0638 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0574 - val_loss: 0.0581 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0559 - val_loss: 0.0554 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0563 - val_loss: 0.0538 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0544 - val_loss: 0.0608 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0522 - val_loss: 0.0610 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0512 - val_loss: 0.0595 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0508 - val_loss: 0.0593 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0512 - val_loss: 0.0576 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0510 - val_loss: 0.0562 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0497 - val_loss: 0.0593 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0515 - val_loss: 0.0571 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0487 - val_loss: 0.0582 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0485 - val_loss: 0.0573 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0494 - val_loss: 0.0587 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0489 - val_loss: 0.0580 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0486 - val_loss: 0.0575 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0494 - val_loss: 0.0574 - lr: 1.4996e-05
Epoch 1/100
26/26 [==============================] - 5s 75ms/step - loss: 0.1459 - val_loss: 0.1237 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 27ms/step - loss: 0.1200 - val_loss: 0.1250 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1065 - val_loss: 0.1077 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1023 - val_loss: 0.0968 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0967 - val_loss: 0.0906 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0937 - val_loss: 0.0849 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0904 - val_loss: 0.0810 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0904 - val_loss: 0.0781 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0843 - val_loss: 0.0742 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0828 - val_loss: 0.0729 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0796 - val_loss: 0.0702 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0768 - val_loss: 0.0663 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0722 - val_loss: 0.0629 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0668 - val_loss: 0.0599 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0656 - val_loss: 0.0572 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0643 - val_loss: 0.0561 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0638 - val_loss: 0.0554 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0661 - val_loss: 0.0529 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0653 - val_loss: 0.0540 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0640 - val_loss: 0.0591 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0584 - val_loss: 0.0572 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0579 - val_loss: 0.0601 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0559 - val_loss: 0.0560 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0546 - val_loss: 0.0562 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0532 - val_loss: 0.0555 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0533 - val_loss: 0.0546 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0530 - val_loss: 0.0554 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0515 - val_loss: 0.0544 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0524 - val_loss: 0.0552 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0517 - val_loss: 0.0545 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0509 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0517 - val_loss: 0.0534 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0544 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0501 - val_loss: 0.0547 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0516 - val_loss: 0.0540 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0512 - val_loss: 0.0539 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0507 - val_loss: 0.0541 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0502 - val_loss: 0.0540 - lr: 4.5166e-06
Epoch 1/100
34/34 [==============================] - 6s 47ms/step - loss: 0.1254 - val_loss: 0.1079 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1073 - val_loss: 0.1047 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1005 - val_loss: 0.1115 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0990 - val_loss: 0.1120 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0945 - val_loss: 0.1045 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0894 - val_loss: 0.1117 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0884 - val_loss: 0.1141 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0854 - val_loss: 0.1169 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0834 - val_loss: 0.1109 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0789 - val_loss: 0.1035 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0754 - val_loss: 0.1082 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0738 - val_loss: 0.1058 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0710 - val_loss: 0.0964 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0675 - val_loss: 0.0960 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0662 - val_loss: 0.0977 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0671 - val_loss: 0.1049 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0705 - val_loss: 0.0966 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0725 - val_loss: 0.0909 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0700 - val_loss: 0.0760 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0641 - val_loss: 0.0750 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0632 - val_loss: 0.0690 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0604 - val_loss: 0.0618 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0596 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0568 - val_loss: 0.0583 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0563 - val_loss: 0.0559 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0541 - val_loss: 0.0548 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0544 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0546 - val_loss: 0.0543 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0539 - val_loss: 0.0529 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0534 - val_loss: 0.0522 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0538 - val_loss: 0.0521 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0522 - val_loss: 0.0528 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0525 - val_loss: 0.0528 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0528 - val_loss: 0.0523 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0534 - val_loss: 0.0520 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0530 - val_loss: 0.0518 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0531 - val_loss: 0.0518 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0522 - val_loss: 0.0518 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0534 - val_loss: 0.0518 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0515 - val_loss: 0.0517 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0533 - val_loss: 0.0517 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0527 - val_loss: 0.0517 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0528 - val_loss: 0.0517 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0525 - val_loss: 0.0516 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0519 - val_loss: 0.0516 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0516 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0530 - val_loss: 0.0516 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0526 - val_loss: 0.0516 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0517 - val_loss: 0.0516 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0522 - val_loss: 0.0516 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0526 - val_loss: 0.0516 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0530 - val_loss: 0.0516 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0525 - val_loss: 0.0516 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0524 - val_loss: 0.0516 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0511 - val_loss: 0.0516 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0527 - val_loss: 0.0516 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0521 - val_loss: 0.0516 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0535 - val_loss: 0.0516 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0528 - val_loss: 0.0516 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0527 - val_loss: 0.0516 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0534 - val_loss: 0.0516 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0523 - val_loss: 0.0516 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0534 - val_loss: 0.0516 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0524 - val_loss: 0.0516 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0523 - val_loss: 0.0516 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0520 - val_loss: 0.0516 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0532 - val_loss: 0.0516 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0537 - val_loss: 0.0516 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0509 - val_loss: 0.0516 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0528 - val_loss: 0.0516 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0517 - val_loss: 0.0516 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0530 - val_loss: 0.0516 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0516 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0516 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0513 - val_loss: 0.0516 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0536 - val_loss: 0.0516 - lr: 1.1370e-14
Epoch 1/100
43/43 [==============================] - 5s 39ms/step - loss: 0.1358 - val_loss: 0.1069 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1094 - val_loss: 0.1028 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0975 - val_loss: 0.0966 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0862 - val_loss: 0.0908 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0806 - val_loss: 0.0886 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0763 - val_loss: 0.0875 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0778 - val_loss: 0.0856 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0721 - val_loss: 0.0830 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0722 - val_loss: 0.0841 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0716 - val_loss: 0.0815 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0666 - val_loss: 0.0811 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0641 - val_loss: 0.0788 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0596 - val_loss: 0.0757 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 2s 42ms/step - loss: 0.0570 - val_loss: 0.0749 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0561 - val_loss: 0.0710 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0528 - val_loss: 0.0696 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0528 - val_loss: 0.0686 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0508 - val_loss: 0.0672 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0501 - val_loss: 0.0663 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0481 - val_loss: 0.0655 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0469 - val_loss: 0.0655 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0466 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0460 - val_loss: 0.0655 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0469 - val_loss: 0.0664 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0467 - val_loss: 0.0676 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0473 - val_loss: 0.0657 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0472 - val_loss: 0.0636 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0621 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0611 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0442 - val_loss: 0.0604 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0445 - val_loss: 0.0603 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0446 - val_loss: 0.0600 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0599 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0598 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0598 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0597 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0438 - val_loss: 0.0597 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0436 - val_loss: 0.0597 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0432 - val_loss: 0.0596 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0429 - val_loss: 0.0597 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0439 - val_loss: 0.0597 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0433 - val_loss: 0.0596 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0437 - val_loss: 0.0596 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0434 - val_loss: 0.0596 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0442 - val_loss: 0.0596 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0596 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0444 - val_loss: 0.0596 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0596 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0437 - val_loss: 0.0596 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0431 - val_loss: 0.0596 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0433 - val_loss: 0.0596 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0433 - val_loss: 0.0596 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0432 - val_loss: 0.0596 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0436 - val_loss: 0.0596 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0596 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0436 - val_loss: 0.0596 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0430 - val_loss: 0.0596 - lr: 3.7654e-13
Average Validation Loss: 0.06284483596682548
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 64}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 219ms/step - loss: 0.1605 - val_loss: 0.1323 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1103 - val_loss: 0.1245 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1017 - val_loss: 0.1305 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1061 - val_loss: 0.1380 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1092 - val_loss: 0.1398 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1133 - val_loss: 0.1356 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1052 - val_loss: 0.1295 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1022 - val_loss: 0.1259 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1001 - val_loss: 0.1229 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0991 - val_loss: 0.1204 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0944 - val_loss: 0.1200 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0931 - val_loss: 0.1218 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0898 - val_loss: 0.1223 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0895 - val_loss: 0.1207 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0892 - val_loss: 0.1182 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0854 - val_loss: 0.1160 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0845 - val_loss: 0.1157 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0811 - val_loss: 0.1151 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0791 - val_loss: 0.1134 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0791 - val_loss: 0.1133 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0798 - val_loss: 0.1129 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0768 - val_loss: 0.1130 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0784 - val_loss: 0.1113 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0730 - val_loss: 0.1103 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0752 - val_loss: 0.1095 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0708 - val_loss: 0.1090 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0721 - val_loss: 0.1088 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0728 - val_loss: 0.1090 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0731 - val_loss: 0.1094 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0710 - val_loss: 0.1096 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0704 - val_loss: 0.1098 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0725 - val_loss: 0.1098 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 49ms/step - loss: 0.0719 - val_loss: 0.1098 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0706 - val_loss: 0.1098 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 48ms/step - loss: 0.0729 - val_loss: 0.1097 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 55ms/step - loss: 0.0729 - val_loss: 0.1096 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 55ms/step - loss: 0.0684 - val_loss: 0.1096 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 70ms/step - loss: 0.0729 - val_loss: 0.1095 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0716 - val_loss: 0.1095 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 54ms/step - loss: 0.0710 - val_loss: 0.1095 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0723 - val_loss: 0.1095 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0733 - val_loss: 0.1095 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0731 - val_loss: 0.1095 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0712 - val_loss: 0.1095 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0713 - val_loss: 0.1095 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0714 - val_loss: 0.1095 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0728 - val_loss: 0.1095 - lr: 1.5073e-07
Epoch 1/100
9/9 [==============================] - 5s 167ms/step - loss: 0.1685 - val_loss: 0.1032 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1227 - val_loss: 0.0788 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1219 - val_loss: 0.0765 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1153 - val_loss: 0.0832 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1111 - val_loss: 0.0798 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1034 - val_loss: 0.0762 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0990 - val_loss: 0.0806 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0917 - val_loss: 0.0734 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0852 - val_loss: 0.0709 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0815 - val_loss: 0.0722 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0783 - val_loss: 0.0743 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0741 - val_loss: 0.0788 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0739 - val_loss: 0.0772 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0718 - val_loss: 0.0781 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0700 - val_loss: 0.0755 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0689 - val_loss: 0.0793 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0704 - val_loss: 0.0766 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0680 - val_loss: 0.0752 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 46ms/step - loss: 0.0679 - val_loss: 0.0793 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0660 - val_loss: 0.0743 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0660 - val_loss: 0.0785 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0670 - val_loss: 0.0751 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0659 - val_loss: 0.0752 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0655 - val_loss: 0.0767 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0650 - val_loss: 0.0764 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0645 - val_loss: 0.0767 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0653 - val_loss: 0.0785 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0668 - val_loss: 0.0784 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0646 - val_loss: 0.0770 - lr: 6.0810e-05
Epoch 1/100
13/13 [==============================] - 4s 89ms/step - loss: 0.1139 - val_loss: 0.1180 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 23ms/step - loss: 0.1060 - val_loss: 0.1146 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1007 - val_loss: 0.1055 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0937 - val_loss: 0.0945 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0896 - val_loss: 0.0829 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0844 - val_loss: 0.0745 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0824 - val_loss: 0.0697 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0773 - val_loss: 0.0673 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0769 - val_loss: 0.0657 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0729 - val_loss: 0.0650 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0717 - val_loss: 0.0640 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0697 - val_loss: 0.0651 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0675 - val_loss: 0.0617 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0661 - val_loss: 0.0596 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0655 - val_loss: 0.0603 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0657 - val_loss: 0.0637 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0618 - val_loss: 0.0601 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0615 - val_loss: 0.0575 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0634 - val_loss: 0.0643 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0602 - val_loss: 0.0582 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0595 - val_loss: 0.0588 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0580 - val_loss: 0.0556 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0592 - val_loss: 0.0588 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0581 - val_loss: 0.0557 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0579 - val_loss: 0.0573 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0577 - val_loss: 0.0572 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0576 - val_loss: 0.0572 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0568 - val_loss: 0.0568 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0558 - val_loss: 0.0575 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0570 - val_loss: 0.0566 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0574 - val_loss: 0.0564 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0576 - val_loss: 0.0570 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0566 - val_loss: 0.0575 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0568 - val_loss: 0.0580 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0559 - val_loss: 0.0578 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0568 - val_loss: 0.0575 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0563 - val_loss: 0.0574 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0571 - val_loss: 0.0572 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0571 - val_loss: 0.0571 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0566 - val_loss: 0.0571 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0562 - val_loss: 0.0571 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0575 - val_loss: 0.0571 - lr: 1.1138e-06
Epoch 1/100
17/17 [==============================] - 4s 72ms/step - loss: 0.1840 - val_loss: 0.1196 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1169 - val_loss: 0.1096 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1160 - val_loss: 0.1021 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1069 - val_loss: 0.1000 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0998 - val_loss: 0.0972 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0954 - val_loss: 0.1039 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0936 - val_loss: 0.0972 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0890 - val_loss: 0.0994 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0869 - val_loss: 0.1014 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0856 - val_loss: 0.1000 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0829 - val_loss: 0.0901 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0783 - val_loss: 0.0857 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0745 - val_loss: 0.0894 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0746 - val_loss: 0.0855 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0733 - val_loss: 0.0818 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0719 - val_loss: 0.0748 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0657 - val_loss: 0.0767 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0657 - val_loss: 0.0741 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0654 - val_loss: 0.0716 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0630 - val_loss: 0.0677 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0632 - val_loss: 0.0614 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0608 - val_loss: 0.0578 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0569 - val_loss: 0.0564 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0551 - val_loss: 0.0561 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0548 - val_loss: 0.0548 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0545 - val_loss: 0.0537 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0550 - val_loss: 0.0532 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0552 - val_loss: 0.0524 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0534 - val_loss: 0.0529 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0545 - val_loss: 0.0522 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0521 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0536 - val_loss: 0.0517 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0531 - val_loss: 0.0515 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0515 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0539 - val_loss: 0.0515 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0522 - val_loss: 0.0515 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0524 - val_loss: 0.0516 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0537 - val_loss: 0.0515 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0514 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0514 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0540 - val_loss: 0.0514 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0513 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0527 - val_loss: 0.0514 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0513 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0527 - val_loss: 0.0513 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0529 - val_loss: 0.0513 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0540 - val_loss: 0.0513 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0530 - val_loss: 0.0513 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0524 - val_loss: 0.0513 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0527 - val_loss: 0.0513 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0540 - val_loss: 0.0513 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0528 - val_loss: 0.0513 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0513 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0534 - val_loss: 0.0513 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0541 - val_loss: 0.0513 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0523 - val_loss: 0.0513 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0537 - val_loss: 0.0513 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0526 - val_loss: 0.0513 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0538 - val_loss: 0.0513 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0513 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0513 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0529 - val_loss: 0.0513 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0535 - val_loss: 0.0513 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0535 - val_loss: 0.0513 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0527 - val_loss: 0.0513 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0513 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0535 - val_loss: 0.0513 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0534 - val_loss: 0.0513 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0536 - val_loss: 0.0513 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0530 - val_loss: 0.0513 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0528 - val_loss: 0.0513 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0537 - val_loss: 0.0513 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0513 - lr: 9.2853e-14
Epoch 1/100
22/22 [==============================] - 5s 64ms/step - loss: 0.1338 - val_loss: 0.1064 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 21ms/step - loss: 0.1061 - val_loss: 0.1018 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0992 - val_loss: 0.1013 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0955 - val_loss: 0.1030 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0969 - val_loss: 0.1014 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0908 - val_loss: 0.0957 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0873 - val_loss: 0.0946 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0837 - val_loss: 0.0928 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0826 - val_loss: 0.0940 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0855 - val_loss: 0.0957 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0831 - val_loss: 0.0900 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0768 - val_loss: 0.0878 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0738 - val_loss: 0.0844 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0703 - val_loss: 0.0825 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0695 - val_loss: 0.0823 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0675 - val_loss: 0.0788 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0647 - val_loss: 0.0773 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0633 - val_loss: 0.0764 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0618 - val_loss: 0.0730 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0603 - val_loss: 0.0733 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0593 - val_loss: 0.0699 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0570 - val_loss: 0.0642 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0536 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0532 - val_loss: 0.0598 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0527 - val_loss: 0.0576 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0581 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0514 - val_loss: 0.0572 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0511 - val_loss: 0.0561 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0518 - val_loss: 0.0562 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0507 - val_loss: 0.0558 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0513 - val_loss: 0.0551 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0504 - val_loss: 0.0550 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0503 - val_loss: 0.0548 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0507 - val_loss: 0.0547 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0501 - val_loss: 0.0546 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0507 - val_loss: 0.0544 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0501 - val_loss: 0.0545 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0497 - val_loss: 0.0545 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0503 - val_loss: 0.0545 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0503 - val_loss: 0.0545 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0505 - val_loss: 0.0545 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0506 - val_loss: 0.0545 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0502 - val_loss: 0.0545 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0504 - val_loss: 0.0545 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0496 - val_loss: 0.0545 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0504 - val_loss: 0.0545 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0508 - val_loss: 0.0545 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0499 - val_loss: 0.0545 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0503 - val_loss: 0.0545 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0501 - val_loss: 0.0545 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0504 - val_loss: 0.0545 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0500 - val_loss: 0.0545 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0494 - val_loss: 0.0545 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0502 - val_loss: 0.0545 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0500 - val_loss: 0.0545 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0514 - val_loss: 0.0545 - lr: 2.2603e-09
Average Validation Loss: 0.06820691674947739
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 64}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 92ms/step - loss: 0.1059 - val_loss: 0.1344 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 25ms/step - loss: 0.1125 - val_loss: 0.1219 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1050 - val_loss: 0.1174 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0954 - val_loss: 0.1188 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0969 - val_loss: 0.1158 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0919 - val_loss: 0.1156 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0928 - val_loss: 0.1104 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0841 - val_loss: 0.1140 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0879 - val_loss: 0.1068 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0716 - val_loss: 0.1026 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0579 - val_loss: 0.1026 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0522 - val_loss: 0.1090 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0525 - val_loss: 0.1003 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0478 - val_loss: 0.1057 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0466 - val_loss: 0.1059 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0479 - val_loss: 0.0907 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0434 - val_loss: 0.0856 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0428 - val_loss: 0.0961 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0457 - val_loss: 0.0929 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0438 - val_loss: 0.0982 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0452 - val_loss: 0.0841 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0411 - val_loss: 0.1033 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0428 - val_loss: 0.0875 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0417 - val_loss: 0.0940 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0433 - val_loss: 0.0889 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0405 - val_loss: 0.0910 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0410 - val_loss: 0.0904 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0409 - val_loss: 0.0871 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0392 - val_loss: 0.0895 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0422 - val_loss: 0.0912 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0398 - val_loss: 0.0910 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0406 - val_loss: 0.0889 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0402 - val_loss: 0.0898 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0393 - val_loss: 0.0899 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0398 - val_loss: 0.0900 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0387 - val_loss: 0.0893 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0397 - val_loss: 0.0893 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0393 - val_loss: 0.0893 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0397 - val_loss: 0.0893 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0390 - val_loss: 0.0895 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0399 - val_loss: 0.0894 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 4s 48ms/step - loss: 0.1158 - val_loss: 0.0700 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1094 - val_loss: 0.0785 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1087 - val_loss: 0.0751 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1063 - val_loss: 0.0653 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1030 - val_loss: 0.0750 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0974 - val_loss: 0.0680 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0985 - val_loss: 0.0736 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0926 - val_loss: 0.0671 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0937 - val_loss: 0.0628 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0923 - val_loss: 0.0612 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0894 - val_loss: 0.0651 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0809 - val_loss: 0.0706 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0819 - val_loss: 0.0646 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0788 - val_loss: 0.0611 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0733 - val_loss: 0.0616 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0712 - val_loss: 0.0596 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0655 - val_loss: 0.0569 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0656 - val_loss: 0.0543 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0613 - val_loss: 0.0551 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0592 - val_loss: 0.0557 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0562 - val_loss: 0.0542 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0548 - val_loss: 0.0494 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0516 - val_loss: 0.0534 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0505 - val_loss: 0.0520 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0502 - val_loss: 0.0496 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0527 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0495 - val_loss: 0.0499 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0490 - val_loss: 0.0523 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0479 - val_loss: 0.0534 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0470 - val_loss: 0.0549 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0468 - val_loss: 0.0536 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0470 - val_loss: 0.0524 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0469 - val_loss: 0.0534 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0468 - val_loss: 0.0539 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0473 - val_loss: 0.0542 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0469 - val_loss: 0.0544 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0488 - val_loss: 0.0544 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0478 - val_loss: 0.0543 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0463 - val_loss: 0.0543 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0479 - val_loss: 0.0543 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0473 - val_loss: 0.0541 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0471 - val_loss: 0.0542 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 5s 33ms/step - loss: 0.1069 - val_loss: 0.1027 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1009 - val_loss: 0.0944 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0973 - val_loss: 0.0866 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0956 - val_loss: 0.0845 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0938 - val_loss: 0.0792 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0882 - val_loss: 0.0760 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0872 - val_loss: 0.0775 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0829 - val_loss: 0.0694 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0853 - val_loss: 0.0726 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0772 - val_loss: 0.0674 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0727 - val_loss: 0.0667 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0684 - val_loss: 0.0572 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0638 - val_loss: 0.0571 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0608 - val_loss: 0.0507 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0580 - val_loss: 0.0539 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0568 - val_loss: 0.0492 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0561 - val_loss: 0.0479 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0525 - val_loss: 0.0485 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0540 - val_loss: 0.0473 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0567 - val_loss: 0.0489 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0539 - val_loss: 0.0472 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0451 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0447 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0531 - val_loss: 0.0458 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0526 - val_loss: 0.0488 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0517 - val_loss: 0.0515 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0518 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0484 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0490 - val_loss: 0.0501 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0475 - val_loss: 0.0503 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0473 - val_loss: 0.0506 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0482 - val_loss: 0.0513 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0474 - val_loss: 0.0508 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0506 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0471 - val_loss: 0.0504 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0465 - val_loss: 0.0506 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0463 - val_loss: 0.0506 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0467 - val_loss: 0.0507 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 2s 34ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0475 - val_loss: 0.0508 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0508 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0478 - val_loss: 0.0508 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0470 - val_loss: 0.0508 - lr: 7.4659e-07
Epoch 1/100
68/68 [==============================] - 5s 29ms/step - loss: 0.1249 - val_loss: 0.1007 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1044 - val_loss: 0.1013 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0985 - val_loss: 0.0958 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0963 - val_loss: 0.0976 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0912 - val_loss: 0.0925 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0863 - val_loss: 0.0905 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0855 - val_loss: 0.0883 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0786 - val_loss: 0.0810 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0739 - val_loss: 0.0807 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0695 - val_loss: 0.0823 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0670 - val_loss: 0.0822 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0654 - val_loss: 0.0778 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0631 - val_loss: 0.0744 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0610 - val_loss: 0.0708 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0587 - val_loss: 0.0688 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0582 - val_loss: 0.0672 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0573 - val_loss: 0.0665 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0543 - val_loss: 0.0682 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0530 - val_loss: 0.0653 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0523 - val_loss: 0.0650 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0516 - val_loss: 0.0677 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0659 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0498 - val_loss: 0.0664 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0508 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0501 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0597 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0495 - val_loss: 0.0565 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0483 - val_loss: 0.0555 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0484 - val_loss: 0.0546 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0481 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0536 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0473 - val_loss: 0.0535 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0459 - val_loss: 0.0534 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0533 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0533 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0462 - val_loss: 0.0532 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0453 - val_loss: 0.0532 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0466 - val_loss: 0.0532 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0532 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0532 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0465 - val_loss: 0.0532 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0532 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0458 - val_loss: 0.0532 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0466 - val_loss: 0.0532 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0531 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0531 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0531 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0531 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0453 - val_loss: 0.0531 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0459 - val_loss: 0.0531 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0531 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0452 - val_loss: 0.0531 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0531 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0465 - val_loss: 0.0531 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0531 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0460 - val_loss: 0.0531 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0470 - val_loss: 0.0531 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0531 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0454 - val_loss: 0.0531 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0531 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0531 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0531 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0464 - val_loss: 0.0531 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0457 - val_loss: 0.0531 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 6s 31ms/step - loss: 0.1126 - val_loss: 0.1002 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0968 - val_loss: 0.0963 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0881 - val_loss: 0.0952 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0856 - val_loss: 0.0930 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0814 - val_loss: 0.0918 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0780 - val_loss: 0.0894 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0745 - val_loss: 0.0872 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0722 - val_loss: 0.0850 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0683 - val_loss: 0.0821 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0663 - val_loss: 0.0787 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0627 - val_loss: 0.0794 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0808 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0814 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0556 - val_loss: 0.0800 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0552 - val_loss: 0.0792 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0525 - val_loss: 0.0793 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0514 - val_loss: 0.0772 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0491 - val_loss: 0.0776 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0494 - val_loss: 0.0742 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0488 - val_loss: 0.0733 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0472 - val_loss: 0.0707 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0446 - val_loss: 0.0669 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0440 - val_loss: 0.0648 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0419 - val_loss: 0.0631 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0402 - val_loss: 0.0616 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0401 - val_loss: 0.0604 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0392 - val_loss: 0.0595 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0398 - val_loss: 0.0592 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0388 - val_loss: 0.0583 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0390 - val_loss: 0.0577 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0386 - val_loss: 0.0572 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0385 - val_loss: 0.0569 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0379 - val_loss: 0.0569 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0380 - val_loss: 0.0567 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0371 - val_loss: 0.0567 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0379 - val_loss: 0.0568 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0383 - val_loss: 0.0568 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0373 - val_loss: 0.0568 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0380 - val_loss: 0.0568 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0375 - val_loss: 0.0568 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0374 - val_loss: 0.0568 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0368 - val_loss: 0.0568 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0370 - val_loss: 0.0568 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0377 - val_loss: 0.0568 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0381 - val_loss: 0.0568 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0376 - val_loss: 0.0568 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0383 - val_loss: 0.0568 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0380 - val_loss: 0.0568 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0378 - val_loss: 0.0568 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0375 - val_loss: 0.0568 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0376 - val_loss: 0.0568 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0380 - val_loss: 0.0568 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0372 - val_loss: 0.0568 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0371 - val_loss: 0.0568 - lr: 6.1442e-09
Average Validation Loss: 0.057608237862586974
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 6s 131ms/step - loss: 0.1222 - val_loss: 0.1280 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1025 - val_loss: 0.1294 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1026 - val_loss: 0.1265 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0995 - val_loss: 0.1230 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0952 - val_loss: 0.1191 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0928 - val_loss: 0.1175 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0901 - val_loss: 0.1178 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0805 - val_loss: 0.1155 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0751 - val_loss: 0.1078 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0684 - val_loss: 0.1064 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0596 - val_loss: 0.1032 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0509 - val_loss: 0.1023 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0516 - val_loss: 0.1054 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0504 - val_loss: 0.1032 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0455 - val_loss: 0.0965 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0458 - val_loss: 0.1009 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0446 - val_loss: 0.0984 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0443 - val_loss: 0.0965 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0435 - val_loss: 0.0935 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0430 - val_loss: 0.1030 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0450 - val_loss: 0.0942 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0428 - val_loss: 0.0971 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0438 - val_loss: 0.0957 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0430 - val_loss: 0.0972 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0437 - val_loss: 0.0948 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0405 - val_loss: 0.0968 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0412 - val_loss: 0.0981 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0396 - val_loss: 0.0955 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0411 - val_loss: 0.0947 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0418 - val_loss: 0.0963 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0424 - val_loss: 0.0967 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0409 - val_loss: 0.0966 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0419 - val_loss: 0.0964 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0408 - val_loss: 0.0961 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0397 - val_loss: 0.0960 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0410 - val_loss: 0.0959 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0412 - val_loss: 0.0959 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0425 - val_loss: 0.0960 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0409 - val_loss: 0.0960 - lr: 3.3460e-06
Epoch 1/100
17/17 [==============================] - 3s 64ms/step - loss: 0.1509 - val_loss: 0.0780 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1169 - val_loss: 0.0681 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1157 - val_loss: 0.0700 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1099 - val_loss: 0.0700 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1063 - val_loss: 0.0689 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1025 - val_loss: 0.0681 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0992 - val_loss: 0.0663 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0951 - val_loss: 0.0669 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0865 - val_loss: 0.0793 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0986 - val_loss: 0.0708 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0819 - val_loss: 0.0746 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0768 - val_loss: 0.0724 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0735 - val_loss: 0.0724 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0697 - val_loss: 0.0748 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0670 - val_loss: 0.0820 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0669 - val_loss: 0.0780 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0626 - val_loss: 0.0784 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0640 - val_loss: 0.0792 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0632 - val_loss: 0.0804 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0628 - val_loss: 0.0816 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0613 - val_loss: 0.0835 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0605 - val_loss: 0.0830 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0612 - val_loss: 0.0807 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0616 - val_loss: 0.0857 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0612 - val_loss: 0.0818 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0615 - val_loss: 0.0835 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0598 - val_loss: 0.0830 - lr: 9.0718e-05
Epoch 1/100
26/26 [==============================] - 4s 51ms/step - loss: 0.1437 - val_loss: 0.1181 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 29ms/step - loss: 0.1000 - val_loss: 0.1055 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0956 - val_loss: 0.0962 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0938 - val_loss: 0.0938 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0884 - val_loss: 0.0881 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0861 - val_loss: 0.0816 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0847 - val_loss: 0.0803 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0823 - val_loss: 0.0768 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0750 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0721 - val_loss: 0.0734 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0681 - val_loss: 0.0667 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0630 - val_loss: 0.0616 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0591 - val_loss: 0.0623 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0604 - val_loss: 0.0628 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0616 - val_loss: 0.0654 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0684 - val_loss: 0.0578 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0621 - val_loss: 0.0534 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0559 - val_loss: 0.0539 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0558 - val_loss: 0.0532 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0573 - val_loss: 0.0499 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0553 - val_loss: 0.0483 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0530 - val_loss: 0.0480 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0501 - val_loss: 0.0478 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0498 - val_loss: 0.0473 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0482 - val_loss: 0.0473 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0485 - val_loss: 0.0473 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0485 - val_loss: 0.0471 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0488 - val_loss: 0.0470 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0476 - val_loss: 0.0470 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0475 - val_loss: 0.0470 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0473 - val_loss: 0.0470 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0482 - val_loss: 0.0470 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0491 - val_loss: 0.0470 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0462 - val_loss: 0.0470 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0472 - val_loss: 0.0470 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0476 - val_loss: 0.0470 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0479 - val_loss: 0.0470 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 40ms/step - loss: 0.0465 - val_loss: 0.0470 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0469 - val_loss: 0.0470 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0470 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0470 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0467 - val_loss: 0.0470 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0470 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0471 - val_loss: 0.0470 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0466 - val_loss: 0.0470 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0472 - val_loss: 0.0470 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0470 - val_loss: 0.0470 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0474 - val_loss: 0.0470 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0465 - val_loss: 0.0470 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0481 - val_loss: 0.0470 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0477 - val_loss: 0.0470 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0468 - val_loss: 0.0470 - lr: 1.6702e-08
Epoch 1/100
34/34 [==============================] - 5s 45ms/step - loss: 0.1115 - val_loss: 0.0981 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0964 - val_loss: 0.1020 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0922 - val_loss: 0.1123 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0880 - val_loss: 0.1203 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0887 - val_loss: 0.1066 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0819 - val_loss: 0.1084 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0792 - val_loss: 0.1031 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0740 - val_loss: 0.0939 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0697 - val_loss: 0.0985 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0686 - val_loss: 0.0882 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0679 - val_loss: 0.0963 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0652 - val_loss: 0.0924 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0650 - val_loss: 0.1009 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0687 - val_loss: 0.1065 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0796 - val_loss: 0.0987 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0778 - val_loss: 0.0766 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0670 - val_loss: 0.0847 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0704 - val_loss: 0.0770 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0659 - val_loss: 0.0746 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0645 - val_loss: 0.0714 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0618 - val_loss: 0.0642 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0586 - val_loss: 0.0629 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0575 - val_loss: 0.0598 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0559 - val_loss: 0.0577 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0546 - val_loss: 0.0566 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0549 - val_loss: 0.0554 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0527 - val_loss: 0.0550 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0531 - val_loss: 0.0544 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0517 - val_loss: 0.0536 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0533 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0513 - val_loss: 0.0533 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0500 - val_loss: 0.0532 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0513 - val_loss: 0.0530 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0499 - val_loss: 0.0529 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0520 - val_loss: 0.0528 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0506 - val_loss: 0.0528 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0528 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0506 - val_loss: 0.0528 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0505 - val_loss: 0.0527 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0501 - val_loss: 0.0527 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0527 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0503 - val_loss: 0.0527 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0504 - val_loss: 0.0527 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0507 - val_loss: 0.0527 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0507 - val_loss: 0.0527 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0512 - val_loss: 0.0527 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0504 - val_loss: 0.0527 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0505 - val_loss: 0.0527 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0497 - val_loss: 0.0527 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0518 - val_loss: 0.0527 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0495 - val_loss: 0.0527 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0497 - val_loss: 0.0527 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0508 - val_loss: 0.0527 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0496 - val_loss: 0.0527 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0495 - val_loss: 0.0527 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0503 - val_loss: 0.0527 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0504 - val_loss: 0.0527 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0515 - val_loss: 0.0527 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0520 - val_loss: 0.0527 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0498 - val_loss: 0.0527 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0498 - val_loss: 0.0527 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0508 - val_loss: 0.0527 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0494 - val_loss: 0.0527 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0498 - val_loss: 0.0527 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0527 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 1.1370e-14
Epoch 77/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0507 - val_loss: 0.0527 - lr: 5.6464e-15
Epoch 78/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0505 - val_loss: 0.0527 - lr: 2.8039e-15
Epoch 79/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 1.3924e-15
Epoch 80/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0502 - val_loss: 0.0527 - lr: 6.9144e-16
Epoch 81/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 3.1068e-16
Epoch 1/100
43/43 [==============================] - 5s 36ms/step - loss: 0.1260 - val_loss: 0.1002 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1005 - val_loss: 0.0935 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0894 - val_loss: 0.0856 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0818 - val_loss: 0.0854 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0751 - val_loss: 0.0812 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0735 - val_loss: 0.0840 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0687 - val_loss: 0.0775 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0704 - val_loss: 0.0804 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0666 - val_loss: 0.0807 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0659 - val_loss: 0.0780 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0620 - val_loss: 0.0773 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0603 - val_loss: 0.0767 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0567 - val_loss: 0.0735 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0527 - val_loss: 0.0728 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0516 - val_loss: 0.0715 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0500 - val_loss: 0.0708 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0490 - val_loss: 0.0689 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0445 - val_loss: 0.0672 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0447 - val_loss: 0.0658 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0438 - val_loss: 0.0652 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0433 - val_loss: 0.0648 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0429 - val_loss: 0.0645 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0431 - val_loss: 0.0648 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0427 - val_loss: 0.0649 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0434 - val_loss: 0.0646 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0431 - val_loss: 0.0639 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0433 - val_loss: 0.0627 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0428 - val_loss: 0.0619 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0422 - val_loss: 0.0609 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0411 - val_loss: 0.0602 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0413 - val_loss: 0.0600 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0407 - val_loss: 0.0599 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0597 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0410 - val_loss: 0.0597 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0403 - val_loss: 0.0596 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0396 - val_loss: 0.0596 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0407 - val_loss: 0.0595 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 2s 48ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0404 - val_loss: 0.0595 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0401 - val_loss: 0.0595 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0398 - val_loss: 0.0595 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0401 - val_loss: 0.0595 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0409 - val_loss: 0.0595 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0400 - val_loss: 0.0595 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0400 - val_loss: 0.0595 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0410 - val_loss: 0.0595 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0407 - val_loss: 0.0595 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0404 - val_loss: 0.0595 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0410 - val_loss: 0.0595 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0401 - val_loss: 0.0595 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0398 - val_loss: 0.0595 - lr: 2.2897e-14
Average Validation Loss: 0.06376742348074912
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 217ms/step - loss: 0.1613 - val_loss: 0.1178 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0915 - val_loss: 0.1201 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0924 - val_loss: 0.1318 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0976 - val_loss: 0.1352 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0994 - val_loss: 0.1305 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0931 - val_loss: 0.1222 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0903 - val_loss: 0.1134 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0840 - val_loss: 0.1081 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0809 - val_loss: 0.1067 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0751 - val_loss: 0.1084 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0714 - val_loss: 0.1125 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0709 - val_loss: 0.1142 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0673 - val_loss: 0.1115 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0617 - val_loss: 0.1097 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0610 - val_loss: 0.1104 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0588 - val_loss: 0.1131 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0563 - val_loss: 0.1114 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0562 - val_loss: 0.1118 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0563 - val_loss: 0.1108 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0535 - val_loss: 0.1096 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0536 - val_loss: 0.1099 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0515 - val_loss: 0.1105 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0533 - val_loss: 0.1108 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0512 - val_loss: 0.1096 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0486 - val_loss: 0.1092 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0492 - val_loss: 0.1087 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0509 - val_loss: 0.1085 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0474 - val_loss: 0.1088 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0495 - val_loss: 0.1089 - lr: 6.0810e-05
Epoch 1/100
9/9 [==============================] - 4s 119ms/step - loss: 0.2050 - val_loss: 0.1336 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1160 - val_loss: 0.0729 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1143 - val_loss: 0.0701 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1095 - val_loss: 0.0703 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1039 - val_loss: 0.0759 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1001 - val_loss: 0.0696 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0915 - val_loss: 0.0635 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0865 - val_loss: 0.0747 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0825 - val_loss: 0.0639 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0769 - val_loss: 0.0774 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0779 - val_loss: 0.0686 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0738 - val_loss: 0.0791 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0719 - val_loss: 0.0695 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0693 - val_loss: 0.0824 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0688 - val_loss: 0.0711 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0679 - val_loss: 0.0786 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0676 - val_loss: 0.0728 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0671 - val_loss: 0.0767 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0649 - val_loss: 0.0734 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0649 - val_loss: 0.0717 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0650 - val_loss: 0.0734 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0635 - val_loss: 0.0726 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0624 - val_loss: 0.0746 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0630 - val_loss: 0.0739 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0628 - val_loss: 0.0710 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0617 - val_loss: 0.0719 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0624 - val_loss: 0.0744 - lr: 9.0718e-05
Epoch 1/100
13/13 [==============================] - 5s 108ms/step - loss: 0.1417 - val_loss: 0.1148 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1099 - val_loss: 0.1092 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1001 - val_loss: 0.1147 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0909 - val_loss: 0.0992 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0854 - val_loss: 0.0895 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0833 - val_loss: 0.0792 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0793 - val_loss: 0.0733 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0746 - val_loss: 0.0667 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0728 - val_loss: 0.0622 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0730 - val_loss: 0.0591 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0684 - val_loss: 0.0578 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0637 - val_loss: 0.0565 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0618 - val_loss: 0.0542 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0627 - val_loss: 0.0537 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0601 - val_loss: 0.0527 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0588 - val_loss: 0.0520 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0588 - val_loss: 0.0517 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0559 - val_loss: 0.0500 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0564 - val_loss: 0.0496 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0551 - val_loss: 0.0491 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0538 - val_loss: 0.0496 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0536 - val_loss: 0.0483 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0531 - val_loss: 0.0485 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0488 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0529 - val_loss: 0.0482 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0524 - val_loss: 0.0478 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0523 - val_loss: 0.0474 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0524 - val_loss: 0.0476 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0522 - val_loss: 0.0476 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0518 - val_loss: 0.0475 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0519 - val_loss: 0.0476 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0517 - val_loss: 0.0477 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0521 - val_loss: 0.0475 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0513 - val_loss: 0.0473 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0518 - val_loss: 0.0473 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0511 - val_loss: 0.0474 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0513 - val_loss: 0.0474 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0512 - val_loss: 0.0474 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0510 - val_loss: 0.0474 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0509 - val_loss: 0.0474 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0511 - val_loss: 0.0474 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0517 - val_loss: 0.0474 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0518 - val_loss: 0.0474 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0514 - val_loss: 0.0474 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0516 - val_loss: 0.0474 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0513 - val_loss: 0.0474 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0507 - val_loss: 0.0474 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0517 - val_loss: 0.0474 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0519 - val_loss: 0.0474 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0509 - val_loss: 0.0474 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0519 - val_loss: 0.0474 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0512 - val_loss: 0.0474 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0517 - val_loss: 0.0474 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0522 - val_loss: 0.0474 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0527 - val_loss: 0.0474 - lr: 3.7267e-09
Epoch 1/100
17/17 [==============================] - 4s 71ms/step - loss: 0.1282 - val_loss: 0.1045 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1122 - val_loss: 0.0970 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1007 - val_loss: 0.0926 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0939 - val_loss: 0.0896 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0888 - val_loss: 0.0880 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0833 - val_loss: 0.0983 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0838 - val_loss: 0.0932 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0805 - val_loss: 0.0794 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0731 - val_loss: 0.0857 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0726 - val_loss: 0.0907 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0704 - val_loss: 0.0857 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0706 - val_loss: 0.0640 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0647 - val_loss: 0.0554 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0582 - val_loss: 0.0540 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0573 - val_loss: 0.0513 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0555 - val_loss: 0.0485 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0573 - val_loss: 0.0413 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0570 - val_loss: 0.0387 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0515 - val_loss: 0.0375 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0500 - val_loss: 0.0366 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0503 - val_loss: 0.0365 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0494 - val_loss: 0.0361 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0493 - val_loss: 0.0361 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0484 - val_loss: 0.0360 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0487 - val_loss: 0.0363 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0477 - val_loss: 0.0359 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0475 - val_loss: 0.0359 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0482 - val_loss: 0.0360 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0476 - val_loss: 0.0359 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0473 - val_loss: 0.0359 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0481 - val_loss: 0.0358 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0479 - val_loss: 0.0357 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0480 - val_loss: 0.0357 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0471 - val_loss: 0.0357 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0473 - val_loss: 0.0357 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0472 - val_loss: 0.0357 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0464 - val_loss: 0.0357 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0475 - val_loss: 0.0356 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0468 - val_loss: 0.0356 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0479 - val_loss: 0.0356 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0476 - val_loss: 0.0356 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0470 - val_loss: 0.0356 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0469 - val_loss: 0.0356 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0476 - val_loss: 0.0356 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0467 - val_loss: 0.0356 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0470 - val_loss: 0.0356 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0467 - val_loss: 0.0356 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0474 - val_loss: 0.0356 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0469 - val_loss: 0.0356 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0474 - val_loss: 0.0356 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0471 - val_loss: 0.0356 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0480 - val_loss: 0.0356 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0481 - val_loss: 0.0356 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0474 - val_loss: 0.0356 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0471 - val_loss: 0.0356 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0479 - val_loss: 0.0356 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0484 - val_loss: 0.0356 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0470 - val_loss: 0.0356 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0468 - val_loss: 0.0356 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0464 - val_loss: 0.0356 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0466 - val_loss: 0.0356 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0479 - val_loss: 0.0356 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0476 - val_loss: 0.0356 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0471 - val_loss: 0.0356 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0467 - val_loss: 0.0356 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0468 - val_loss: 0.0356 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0473 - val_loss: 0.0356 - lr: 1.1370e-14
Epoch 1/100
22/22 [==============================] - 5s 59ms/step - loss: 0.1214 - val_loss: 0.1043 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1044 - val_loss: 0.1001 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0994 - val_loss: 0.1001 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0950 - val_loss: 0.1009 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0958 - val_loss: 0.1012 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0912 - val_loss: 0.0984 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0885 - val_loss: 0.0985 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0886 - val_loss: 0.1002 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0889 - val_loss: 0.0989 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0827 - val_loss: 0.0958 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0803 - val_loss: 0.0970 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0813 - val_loss: 0.0961 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0779 - val_loss: 0.0945 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0733 - val_loss: 0.0942 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0720 - val_loss: 0.0922 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0698 - val_loss: 0.0927 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0661 - val_loss: 0.0906 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0639 - val_loss: 0.0900 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0614 - val_loss: 0.0893 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0601 - val_loss: 0.0889 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0596 - val_loss: 0.0879 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0575 - val_loss: 0.0848 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0543 - val_loss: 0.0839 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0537 - val_loss: 0.0829 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0519 - val_loss: 0.0812 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0513 - val_loss: 0.0808 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0512 - val_loss: 0.0803 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0496 - val_loss: 0.0794 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0502 - val_loss: 0.0791 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0503 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0497 - val_loss: 0.0788 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0493 - val_loss: 0.0787 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0493 - val_loss: 0.0785 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0491 - val_loss: 0.0783 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0486 - val_loss: 0.0783 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0480 - val_loss: 0.0784 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0494 - val_loss: 0.0783 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0494 - val_loss: 0.0783 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0488 - val_loss: 0.0782 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0488 - val_loss: 0.0782 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0493 - val_loss: 0.0782 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0491 - val_loss: 0.0782 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0484 - val_loss: 0.0782 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0487 - val_loss: 0.0782 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0492 - val_loss: 0.0782 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0492 - val_loss: 0.0782 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0496 - val_loss: 0.0782 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0487 - val_loss: 0.0782 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0488 - val_loss: 0.0782 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0485 - val_loss: 0.0782 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0493 - val_loss: 0.0782 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0485 - val_loss: 0.0782 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0496 - val_loss: 0.0782 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0490 - val_loss: 0.0782 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0490 - val_loss: 0.0782 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0493 - val_loss: 0.0782 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 9.2853e-14
Average Validation Loss: 0.06628555133938789
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 71ms/step - loss: 0.1849 - val_loss: 0.1909 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1722 - val_loss: 0.1832 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1602 - val_loss: 0.1753 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 23ms/step - loss: 0.1553 - val_loss: 0.1657 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1458 - val_loss: 0.1627 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1451 - val_loss: 0.1525 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1222 - val_loss: 0.1595 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1235 - val_loss: 0.1495 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1086 - val_loss: 0.1573 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1010 - val_loss: 0.1764 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1150 - val_loss: 0.1355 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1061 - val_loss: 0.1361 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0900 - val_loss: 0.1291 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0837 - val_loss: 0.1339 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0856 - val_loss: 0.1245 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0828 - val_loss: 0.1197 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0800 - val_loss: 0.1351 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0788 - val_loss: 0.1269 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0812 - val_loss: 0.1181 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0758 - val_loss: 0.1343 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0794 - val_loss: 0.1187 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0769 - val_loss: 0.1248 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0740 - val_loss: 0.1208 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 1s 36ms/step - loss: 0.0756 - val_loss: 0.1244 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0749 - val_loss: 0.1297 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0759 - val_loss: 0.1216 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0742 - val_loss: 0.1225 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0733 - val_loss: 0.1262 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0744 - val_loss: 0.1244 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0724 - val_loss: 0.1214 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0733 - val_loss: 0.1215 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0727 - val_loss: 0.1230 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0733 - val_loss: 0.1220 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0720 - val_loss: 0.1217 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0738 - val_loss: 0.1210 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0726 - val_loss: 0.1211 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0748 - val_loss: 0.1212 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0728 - val_loss: 0.1215 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0758 - val_loss: 0.1215 - lr: 3.3460e-06
Epoch 1/100
34/34 [==============================] - 4s 44ms/step - loss: 0.1915 - val_loss: 0.1349 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1733 - val_loss: 0.1274 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1638 - val_loss: 0.1170 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1528 - val_loss: 0.1126 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1500 - val_loss: 0.0995 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1413 - val_loss: 0.1073 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1379 - val_loss: 0.0904 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1322 - val_loss: 0.0972 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1251 - val_loss: 0.1011 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1286 - val_loss: 0.0853 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1158 - val_loss: 0.0993 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1106 - val_loss: 0.0976 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1103 - val_loss: 0.0864 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1060 - val_loss: 0.0898 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0999 - val_loss: 0.0887 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0946 - val_loss: 0.0907 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0953 - val_loss: 0.0847 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0900 - val_loss: 0.0851 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0858 - val_loss: 0.0858 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0833 - val_loss: 0.0813 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0813 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0795 - val_loss: 0.0780 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0764 - val_loss: 0.0780 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0751 - val_loss: 0.0781 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0748 - val_loss: 0.0777 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0732 - val_loss: 0.0784 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0718 - val_loss: 0.0780 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0706 - val_loss: 0.0786 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0705 - val_loss: 0.0786 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0710 - val_loss: 0.0776 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0721 - val_loss: 0.0785 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0700 - val_loss: 0.0797 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0694 - val_loss: 0.0796 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0798 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0713 - val_loss: 0.0796 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0698 - val_loss: 0.0794 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0707 - val_loss: 0.0793 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0692 - val_loss: 0.0792 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0707 - val_loss: 0.0792 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0711 - val_loss: 0.0793 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0696 - val_loss: 0.0793 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0714 - val_loss: 0.0793 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0704 - val_loss: 0.0792 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0699 - val_loss: 0.0792 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0720 - val_loss: 0.0792 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0690 - val_loss: 0.0792 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0693 - val_loss: 0.0792 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0689 - val_loss: 0.0792 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0696 - val_loss: 0.0792 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0717 - val_loss: 0.0792 - lr: 4.5400e-08
Epoch 1/100
51/51 [==============================] - 4s 31ms/step - loss: 0.1876 - val_loss: 0.1696 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1545 - val_loss: 0.1482 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1428 - val_loss: 0.1345 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1335 - val_loss: 0.1241 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1277 - val_loss: 0.1180 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1245 - val_loss: 0.1142 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1186 - val_loss: 0.1088 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1142 - val_loss: 0.1050 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1096 - val_loss: 0.1023 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 22ms/step - loss: 0.1031 - val_loss: 0.0932 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1081 - val_loss: 0.0984 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0954 - val_loss: 0.0842 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0919 - val_loss: 0.0859 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0864 - val_loss: 0.0743 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0821 - val_loss: 0.0740 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0767 - val_loss: 0.0661 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0725 - val_loss: 0.0672 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0735 - val_loss: 0.0634 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0677 - val_loss: 0.0599 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0680 - val_loss: 0.0606 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0663 - val_loss: 0.0581 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0644 - val_loss: 0.0583 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0645 - val_loss: 0.0569 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0636 - val_loss: 0.0561 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0627 - val_loss: 0.0557 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0638 - val_loss: 0.0555 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0638 - val_loss: 0.0566 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0631 - val_loss: 0.0579 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0582 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0613 - val_loss: 0.0581 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0621 - val_loss: 0.0590 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0616 - val_loss: 0.0580 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0616 - val_loss: 0.0584 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0582 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0583 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0608 - val_loss: 0.0580 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0581 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0582 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0583 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0598 - val_loss: 0.0584 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0611 - val_loss: 0.0583 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0583 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0609 - val_loss: 0.0583 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0601 - val_loss: 0.0583 - lr: 2.2487e-07
Epoch 1/100
68/68 [==============================] - 5s 28ms/step - loss: 0.1862 - val_loss: 0.1522 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1497 - val_loss: 0.1438 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1384 - val_loss: 0.1340 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1297 - val_loss: 0.1232 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1234 - val_loss: 0.1173 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1183 - val_loss: 0.1120 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1122 - val_loss: 0.1046 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1089 - val_loss: 0.1027 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1028 - val_loss: 0.0971 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1023 - val_loss: 0.0972 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0947 - val_loss: 0.0898 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0895 - val_loss: 0.0925 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0859 - val_loss: 0.0841 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0803 - val_loss: 0.0839 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0759 - val_loss: 0.0881 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0770 - val_loss: 0.0795 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0753 - val_loss: 0.0774 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0722 - val_loss: 0.0737 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0699 - val_loss: 0.0724 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0694 - val_loss: 0.0707 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0684 - val_loss: 0.0689 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0660 - val_loss: 0.0667 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0647 - val_loss: 0.0651 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0641 - val_loss: 0.0639 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0625 - val_loss: 0.0649 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0625 - val_loss: 0.0645 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0625 - val_loss: 0.0641 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0624 - val_loss: 0.0590 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0621 - val_loss: 0.0563 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0551 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0613 - val_loss: 0.0534 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0611 - val_loss: 0.0533 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0531 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0530 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0605 - val_loss: 0.0530 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0593 - val_loss: 0.0530 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0597 - val_loss: 0.0529 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0598 - val_loss: 0.0529 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0588 - val_loss: 0.0529 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0599 - val_loss: 0.0529 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0605 - val_loss: 0.0529 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0592 - val_loss: 0.0528 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0603 - val_loss: 0.0528 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0592 - val_loss: 0.0528 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0590 - val_loss: 0.0528 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0598 - val_loss: 0.0528 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0588 - val_loss: 0.0528 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0588 - val_loss: 0.0528 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0598 - val_loss: 0.0528 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0605 - val_loss: 0.0528 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0597 - val_loss: 0.0528 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0607 - val_loss: 0.0528 - lr: 9.2853e-14
Epoch 1/100
85/85 [==============================] - 5s 25ms/step - loss: 0.1889 - val_loss: 0.1470 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1502 - val_loss: 0.1308 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1352 - val_loss: 0.1208 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1264 - val_loss: 0.1144 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1202 - val_loss: 0.1084 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1143 - val_loss: 0.1027 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1127 - val_loss: 0.1009 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1090 - val_loss: 0.1021 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1046 - val_loss: 0.1015 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 20ms/step - loss: 0.1007 - val_loss: 0.0933 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0949 - val_loss: 0.0890 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0916 - val_loss: 0.0874 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0878 - val_loss: 0.0837 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0839 - val_loss: 0.0824 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0815 - val_loss: 0.0802 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0774 - val_loss: 0.0787 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0748 - val_loss: 0.0778 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0739 - val_loss: 0.0762 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0719 - val_loss: 0.0755 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0708 - val_loss: 0.0735 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0670 - val_loss: 0.0721 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0657 - val_loss: 0.0705 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0625 - val_loss: 0.0698 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0693 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0611 - val_loss: 0.0688 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0601 - val_loss: 0.0699 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0596 - val_loss: 0.0703 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0590 - val_loss: 0.0706 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0584 - val_loss: 0.0692 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0591 - val_loss: 0.0691 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0691 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0584 - val_loss: 0.0680 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0570 - val_loss: 0.0675 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0569 - val_loss: 0.0672 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0670 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0570 - val_loss: 0.0666 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0571 - val_loss: 0.0666 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0567 - val_loss: 0.0665 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0579 - val_loss: 0.0665 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0563 - val_loss: 0.0664 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0575 - val_loss: 0.0664 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0576 - val_loss: 0.0664 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0567 - val_loss: 0.0664 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0562 - val_loss: 0.0664 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0578 - val_loss: 0.0664 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0562 - val_loss: 0.0664 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0569 - val_loss: 0.0664 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0566 - val_loss: 0.0664 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0567 - val_loss: 0.0664 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0664 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0564 - val_loss: 0.0664 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0565 - val_loss: 0.0664 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0566 - val_loss: 0.0664 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0664 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0567 - val_loss: 0.0664 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0564 - val_loss: 0.0664 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0568 - val_loss: 0.0664 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0569 - val_loss: 0.0664 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0576 - val_loss: 0.0664 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0664 - lr: 9.2853e-14
Average Validation Loss: 0.07409415245056153
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 120ms/step - loss: 0.2673 - val_loss: 0.2112 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1759 - val_loss: 0.1844 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1614 - val_loss: 0.1879 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1617 - val_loss: 0.1857 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1615 - val_loss: 0.1796 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1562 - val_loss: 0.1742 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1562 - val_loss: 0.1685 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1440 - val_loss: 0.1649 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1421 - val_loss: 0.1619 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1401 - val_loss: 0.1592 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1354 - val_loss: 0.1573 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1332 - val_loss: 0.1556 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1305 - val_loss: 0.1531 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1262 - val_loss: 0.1503 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1202 - val_loss: 0.1494 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1217 - val_loss: 0.1463 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1187 - val_loss: 0.1429 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1144 - val_loss: 0.1413 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1118 - val_loss: 0.1383 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1080 - val_loss: 0.1363 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1039 - val_loss: 0.1354 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1059 - val_loss: 0.1328 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1032 - val_loss: 0.1301 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0999 - val_loss: 0.1301 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0988 - val_loss: 0.1303 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0979 - val_loss: 0.1287 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0965 - val_loss: 0.1284 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0982 - val_loss: 0.1286 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0945 - val_loss: 0.1288 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0934 - val_loss: 0.1281 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0927 - val_loss: 0.1275 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0946 - val_loss: 0.1270 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0945 - val_loss: 0.1267 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0936 - val_loss: 0.1266 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0942 - val_loss: 0.1268 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0940 - val_loss: 0.1268 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0921 - val_loss: 0.1268 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0946 - val_loss: 0.1267 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0915 - val_loss: 0.1267 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0925 - val_loss: 0.1267 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0935 - val_loss: 0.1268 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0910 - val_loss: 0.1268 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0954 - val_loss: 0.1268 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0926 - val_loss: 0.1268 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0917 - val_loss: 0.1268 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0921 - val_loss: 0.1268 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0941 - val_loss: 0.1268 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0941 - val_loss: 0.1268 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0919 - val_loss: 0.1268 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0937 - val_loss: 0.1268 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0945 - val_loss: 0.1268 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0941 - val_loss: 0.1268 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0956 - val_loss: 0.1268 - lr: 1.0130e-08
Epoch 54/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0924 - val_loss: 0.1268 - lr: 6.1442e-09
Epoch 1/100
17/17 [==============================] - 5s 135ms/step - loss: 0.2025 - val_loss: 0.1419 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1780 - val_loss: 0.1293 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1656 - val_loss: 0.1253 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1547 - val_loss: 0.1177 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1459 - val_loss: 0.1092 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1400 - val_loss: 0.1058 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1336 - val_loss: 0.0994 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1265 - val_loss: 0.0984 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1221 - val_loss: 0.0959 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1146 - val_loss: 0.0954 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1125 - val_loss: 0.0933 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1063 - val_loss: 0.0950 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1034 - val_loss: 0.0903 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0997 - val_loss: 0.0880 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0986 - val_loss: 0.0873 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0941 - val_loss: 0.0891 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0933 - val_loss: 0.0879 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0906 - val_loss: 0.0868 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0901 - val_loss: 0.0886 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0889 - val_loss: 0.0896 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0884 - val_loss: 0.0837 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0887 - val_loss: 0.0873 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0888 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0879 - val_loss: 0.0854 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0867 - val_loss: 0.0855 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0869 - val_loss: 0.0865 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0856 - val_loss: 0.0851 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0861 - val_loss: 0.0860 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0864 - val_loss: 0.0851 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0853 - val_loss: 0.0858 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0836 - val_loss: 0.0856 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0847 - val_loss: 0.0850 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0864 - val_loss: 0.0854 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0858 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0845 - val_loss: 0.0859 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0859 - val_loss: 0.0856 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0851 - val_loss: 0.0854 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0840 - val_loss: 0.0853 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0851 - val_loss: 0.0851 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0849 - val_loss: 0.0852 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0856 - val_loss: 0.0853 - lr: 1.6616e-06
Epoch 1/100
26/26 [==============================] - 4s 51ms/step - loss: 0.1979 - val_loss: 0.1707 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1636 - val_loss: 0.1598 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1496 - val_loss: 0.1428 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1409 - val_loss: 0.1311 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1333 - val_loss: 0.1185 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1268 - val_loss: 0.1133 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1256 - val_loss: 0.1096 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1235 - val_loss: 0.1028 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1164 - val_loss: 0.1000 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1131 - val_loss: 0.0980 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1077 - val_loss: 0.0947 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1068 - val_loss: 0.0921 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1043 - val_loss: 0.0895 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1031 - val_loss: 0.0866 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0985 - val_loss: 0.0840 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0946 - val_loss: 0.0828 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0959 - val_loss: 0.0808 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0926 - val_loss: 0.0798 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0913 - val_loss: 0.0787 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0888 - val_loss: 0.0782 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0864 - val_loss: 0.0771 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0865 - val_loss: 0.0772 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0849 - val_loss: 0.0759 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0852 - val_loss: 0.0764 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0848 - val_loss: 0.0767 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0854 - val_loss: 0.0772 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 33ms/step - loss: 0.0818 - val_loss: 0.0757 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0835 - val_loss: 0.0775 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0812 - val_loss: 0.0761 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0813 - val_loss: 0.0759 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0825 - val_loss: 0.0763 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0815 - val_loss: 0.0763 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0813 - val_loss: 0.0761 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0811 - val_loss: 0.0760 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0806 - val_loss: 0.0760 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0820 - val_loss: 0.0760 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0806 - val_loss: 0.0758 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0801 - val_loss: 0.0757 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0799 - val_loss: 0.0757 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0805 - val_loss: 0.0757 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0812 - val_loss: 0.0757 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0814 - val_loss: 0.0758 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0809 - val_loss: 0.0758 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0820 - val_loss: 0.0758 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0804 - val_loss: 0.0758 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0801 - val_loss: 0.0758 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0808 - val_loss: 0.0758 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0817 - val_loss: 0.0758 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0810 - val_loss: 0.0758 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0811 - val_loss: 0.0758 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0798 - val_loss: 0.0758 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0818 - val_loss: 0.0758 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0809 - val_loss: 0.0758 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0809 - val_loss: 0.0758 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0807 - val_loss: 0.0758 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0805 - val_loss: 0.0758 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0807 - val_loss: 0.0758 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0810 - val_loss: 0.0758 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0813 - val_loss: 0.0758 - lr: 5.0435e-10
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1854 - val_loss: 0.1592 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1571 - val_loss: 0.1605 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1464 - val_loss: 0.1563 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1377 - val_loss: 0.1566 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1285 - val_loss: 0.1399 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1193 - val_loss: 0.1335 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1130 - val_loss: 0.1231 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1071 - val_loss: 0.1141 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1001 - val_loss: 0.1042 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0973 - val_loss: 0.1032 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0909 - val_loss: 0.0971 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0889 - val_loss: 0.0922 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0878 - val_loss: 0.0986 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0857 - val_loss: 0.0956 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0815 - val_loss: 0.0941 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0813 - val_loss: 0.1026 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0812 - val_loss: 0.1014 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0812 - val_loss: 0.1039 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0834 - val_loss: 0.1083 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0875 - val_loss: 0.1022 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0885 - val_loss: 0.0851 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0848 - val_loss: 0.0738 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0795 - val_loss: 0.0726 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0780 - val_loss: 0.0698 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0763 - val_loss: 0.0692 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0752 - val_loss: 0.0678 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0740 - val_loss: 0.0676 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0744 - val_loss: 0.0671 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0739 - val_loss: 0.0669 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0725 - val_loss: 0.0666 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0734 - val_loss: 0.0663 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0719 - val_loss: 0.0662 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0725 - val_loss: 0.0660 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0717 - val_loss: 0.0659 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0707 - val_loss: 0.0659 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0719 - val_loss: 0.0659 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0719 - val_loss: 0.0658 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0718 - val_loss: 0.0658 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0718 - val_loss: 0.0658 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0719 - val_loss: 0.0658 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0714 - val_loss: 0.0658 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0717 - val_loss: 0.0658 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0719 - val_loss: 0.0658 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0714 - val_loss: 0.0658 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0717 - val_loss: 0.0658 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0716 - val_loss: 0.0658 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0724 - val_loss: 0.0658 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 9.2136e-11
Epoch 1/100
43/43 [==============================] - 5s 38ms/step - loss: 0.1839 - val_loss: 0.1556 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1573 - val_loss: 0.1437 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1448 - val_loss: 0.1298 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1324 - val_loss: 0.1192 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1205 - val_loss: 0.1094 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1140 - val_loss: 0.1038 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1079 - val_loss: 0.1004 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1049 - val_loss: 0.0967 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1011 - val_loss: 0.0932 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0975 - val_loss: 0.0905 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0942 - val_loss: 0.0875 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0884 - val_loss: 0.0841 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0848 - val_loss: 0.0823 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0829 - val_loss: 0.0795 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0786 - val_loss: 0.0784 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0773 - val_loss: 0.0761 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0749 - val_loss: 0.0734 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0725 - val_loss: 0.0723 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0714 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0706 - val_loss: 0.0690 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0685 - val_loss: 0.0668 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0656 - val_loss: 0.0658 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0638 - val_loss: 0.0643 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0640 - val_loss: 0.0631 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0628 - val_loss: 0.0630 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0618 - val_loss: 0.0624 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0633 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0620 - val_loss: 0.0625 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0612 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0623 - val_loss: 0.0604 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0627 - val_loss: 0.0603 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0620 - val_loss: 0.0600 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0600 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0614 - val_loss: 0.0600 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0608 - val_loss: 0.0600 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0612 - val_loss: 0.0600 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0609 - val_loss: 0.0599 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0599 - val_loss: 0.0599 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0600 - val_loss: 0.0599 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0609 - val_loss: 0.0599 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0611 - val_loss: 0.0599 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0601 - val_loss: 0.0599 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0598 - val_loss: 0.0599 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0606 - val_loss: 0.0599 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0599 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0606 - val_loss: 0.0599 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0612 - val_loss: 0.0599 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0603 - val_loss: 0.0599 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0599 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0609 - val_loss: 0.0599 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0597 - val_loss: 0.0599 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0604 - val_loss: 0.0599 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0604 - val_loss: 0.0599 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0604 - val_loss: 0.0599 - lr: 8.3153e-10
Average Validation Loss: 0.08233513757586479
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 219ms/step - loss: 0.2372 - val_loss: 0.2114 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1831 - val_loss: 0.1905 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1665 - val_loss: 0.1943 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1701 - val_loss: 0.1969 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1702 - val_loss: 0.1957 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1685 - val_loss: 0.1914 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1655 - val_loss: 0.1855 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1622 - val_loss: 0.1798 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1565 - val_loss: 0.1758 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1507 - val_loss: 0.1748 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1508 - val_loss: 0.1745 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1459 - val_loss: 0.1747 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1426 - val_loss: 0.1742 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1419 - val_loss: 0.1728 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1403 - val_loss: 0.1703 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1364 - val_loss: 0.1681 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1370 - val_loss: 0.1663 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1325 - val_loss: 0.1662 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1313 - val_loss: 0.1660 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1320 - val_loss: 0.1646 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1264 - val_loss: 0.1629 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1261 - val_loss: 0.1618 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1254 - val_loss: 0.1610 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1204 - val_loss: 0.1605 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1224 - val_loss: 0.1602 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1232 - val_loss: 0.1596 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1214 - val_loss: 0.1594 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1194 - val_loss: 0.1591 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1191 - val_loss: 0.1587 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1178 - val_loss: 0.1583 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1172 - val_loss: 0.1580 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1207 - val_loss: 0.1578 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1225 - val_loss: 0.1576 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1168 - val_loss: 0.1575 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1188 - val_loss: 0.1575 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1165 - val_loss: 0.1575 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1192 - val_loss: 0.1575 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1182 - val_loss: 0.1574 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1205 - val_loss: 0.1574 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1179 - val_loss: 0.1574 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1168 - val_loss: 0.1574 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1174 - val_loss: 0.1574 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1179 - val_loss: 0.1574 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1174 - val_loss: 0.1574 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1193 - val_loss: 0.1574 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1166 - val_loss: 0.1574 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1196 - val_loss: 0.1574 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1209 - val_loss: 0.1574 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1153 - val_loss: 0.1574 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1211 - val_loss: 0.1574 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1199 - val_loss: 0.1574 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1201 - val_loss: 0.1574 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1219 - val_loss: 0.1574 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1203 - val_loss: 0.1574 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1152 - val_loss: 0.1574 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1219 - val_loss: 0.1574 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1203 - val_loss: 0.1574 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1196 - val_loss: 0.1574 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1212 - val_loss: 0.1574 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1181 - val_loss: 0.1574 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1174 - val_loss: 0.1574 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1194 - val_loss: 0.1574 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1201 - val_loss: 0.1574 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1182 - val_loss: 0.1574 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1196 - val_loss: 0.1574 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1190 - val_loss: 0.1574 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1180 - val_loss: 0.1574 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1207 - val_loss: 0.1574 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1189 - val_loss: 0.1574 - lr: 9.2853e-14
Epoch 1/100
9/9 [==============================] - 4s 122ms/step - loss: 0.2188 - val_loss: 0.1440 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1806 - val_loss: 0.1342 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1772 - val_loss: 0.1301 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1659 - val_loss: 0.1408 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1601 - val_loss: 0.1273 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1529 - val_loss: 0.1192 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1431 - val_loss: 0.1241 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1378 - val_loss: 0.1183 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1348 - val_loss: 0.1230 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1283 - val_loss: 0.1215 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1232 - val_loss: 0.1155 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1211 - val_loss: 0.1271 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1177 - val_loss: 0.1234 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1150 - val_loss: 0.1198 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1133 - val_loss: 0.1158 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1128 - val_loss: 0.1213 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1094 - val_loss: 0.1163 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1074 - val_loss: 0.1141 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1057 - val_loss: 0.1155 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1037 - val_loss: 0.1134 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1046 - val_loss: 0.1205 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1036 - val_loss: 0.1120 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1044 - val_loss: 0.1164 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1039 - val_loss: 0.1135 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1039 - val_loss: 0.1119 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1034 - val_loss: 0.1168 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1014 - val_loss: 0.1159 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0995 - val_loss: 0.1148 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1020 - val_loss: 0.1148 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1026 - val_loss: 0.1123 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1018 - val_loss: 0.1109 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1007 - val_loss: 0.1114 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1008 - val_loss: 0.1118 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1024 - val_loss: 0.1124 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1009 - val_loss: 0.1130 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1016 - val_loss: 0.1133 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1018 - val_loss: 0.1135 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1034 - val_loss: 0.1135 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0985 - val_loss: 0.1135 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1019 - val_loss: 0.1135 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0999 - val_loss: 0.1135 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1009 - val_loss: 0.1135 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1000 - val_loss: 0.1135 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1012 - val_loss: 0.1135 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1006 - val_loss: 0.1135 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1021 - val_loss: 0.1135 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1013 - val_loss: 0.1135 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1001 - val_loss: 0.1135 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1019 - val_loss: 0.1135 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1015 - val_loss: 0.1135 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1011 - val_loss: 0.1135 - lr: 2.7536e-08
Epoch 1/100
13/13 [==============================] - 5s 93ms/step - loss: 0.2847 - val_loss: 0.2311 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1791 - val_loss: 0.1786 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1701 - val_loss: 0.1724 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1591 - val_loss: 0.1648 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1467 - val_loss: 0.1502 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1439 - val_loss: 0.1411 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1352 - val_loss: 0.1325 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1315 - val_loss: 0.1250 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1267 - val_loss: 0.1226 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1171 - val_loss: 0.1129 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1149 - val_loss: 0.1098 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1104 - val_loss: 0.1060 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 27ms/step - loss: 0.1083 - val_loss: 0.1022 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1033 - val_loss: 0.1019 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 27ms/step - loss: 0.1024 - val_loss: 0.1024 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0992 - val_loss: 0.0994 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0969 - val_loss: 0.0995 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0950 - val_loss: 0.0928 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0933 - val_loss: 0.0891 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0924 - val_loss: 0.0893 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0932 - val_loss: 0.0895 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0902 - val_loss: 0.0840 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0894 - val_loss: 0.0862 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0885 - val_loss: 0.0841 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0890 - val_loss: 0.0850 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0886 - val_loss: 0.0843 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0883 - val_loss: 0.0866 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0875 - val_loss: 0.0836 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0872 - val_loss: 0.0850 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0896 - val_loss: 0.0852 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0873 - val_loss: 0.0849 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0880 - val_loss: 0.0836 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0876 - val_loss: 0.0843 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.0848 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0874 - val_loss: 0.0846 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0870 - val_loss: 0.0844 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0884 - val_loss: 0.0844 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0879 - val_loss: 0.0843 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0843 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0876 - val_loss: 0.0843 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.0843 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0868 - val_loss: 0.0843 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0868 - val_loss: 0.0843 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0843 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0863 - val_loss: 0.0843 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 50ms/step - loss: 0.0862 - val_loss: 0.0842 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0868 - val_loss: 0.0842 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0867 - val_loss: 0.0842 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0865 - val_loss: 0.0842 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0873 - val_loss: 0.0842 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0856 - val_loss: 0.0842 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0865 - val_loss: 0.0842 - lr: 1.6702e-08
Epoch 1/100
17/17 [==============================] - 5s 75ms/step - loss: 0.2000 - val_loss: 0.1648 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1709 - val_loss: 0.1507 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1544 - val_loss: 0.1443 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1449 - val_loss: 0.1356 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1346 - val_loss: 0.1520 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1344 - val_loss: 0.1392 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1289 - val_loss: 0.1218 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1177 - val_loss: 0.1218 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1150 - val_loss: 0.1387 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1191 - val_loss: 0.1227 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1137 - val_loss: 0.1040 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1031 - val_loss: 0.1096 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1032 - val_loss: 0.1154 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1046 - val_loss: 0.1014 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0980 - val_loss: 0.0998 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0957 - val_loss: 0.0977 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0954 - val_loss: 0.0963 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0946 - val_loss: 0.0906 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0914 - val_loss: 0.0876 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0883 - val_loss: 0.0890 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0882 - val_loss: 0.0834 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0859 - val_loss: 0.0830 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0858 - val_loss: 0.0816 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0852 - val_loss: 0.0805 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0853 - val_loss: 0.0791 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0841 - val_loss: 0.0789 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0837 - val_loss: 0.0791 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0837 - val_loss: 0.0781 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0826 - val_loss: 0.0784 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0834 - val_loss: 0.0778 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0775 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0775 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0814 - val_loss: 0.0775 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0818 - val_loss: 0.0773 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0835 - val_loss: 0.0772 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0772 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0820 - val_loss: 0.0772 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0818 - val_loss: 0.0772 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0808 - val_loss: 0.0772 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0830 - val_loss: 0.0772 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0827 - val_loss: 0.0772 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0825 - val_loss: 0.0772 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0817 - val_loss: 0.0772 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0827 - val_loss: 0.0772 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0822 - val_loss: 0.0772 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0772 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0772 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0819 - val_loss: 0.0772 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0836 - val_loss: 0.0772 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0817 - val_loss: 0.0772 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0822 - val_loss: 0.0772 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0814 - val_loss: 0.0772 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0822 - val_loss: 0.0772 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0821 - val_loss: 0.0772 - lr: 8.3153e-10
Epoch 1/100
22/22 [==============================] - 4s 59ms/step - loss: 0.1938 - val_loss: 0.1620 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1677 - val_loss: 0.1508 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1512 - val_loss: 0.1447 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1421 - val_loss: 0.1388 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1366 - val_loss: 0.1341 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1313 - val_loss: 0.1307 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 25ms/step - loss: 0.1256 - val_loss: 0.1263 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1211 - val_loss: 0.1244 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1180 - val_loss: 0.1204 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1141 - val_loss: 0.1169 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1093 - val_loss: 0.1142 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1071 - val_loss: 0.1134 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1018 - val_loss: 0.1079 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0993 - val_loss: 0.1075 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0987 - val_loss: 0.1065 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0963 - val_loss: 0.1046 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0934 - val_loss: 0.1023 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0913 - val_loss: 0.1008 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0890 - val_loss: 0.0963 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0871 - val_loss: 0.0941 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0852 - val_loss: 0.0938 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0838 - val_loss: 0.0901 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0810 - val_loss: 0.0885 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0802 - val_loss: 0.0875 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0790 - val_loss: 0.0864 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0793 - val_loss: 0.0859 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0782 - val_loss: 0.0848 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0775 - val_loss: 0.0846 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0781 - val_loss: 0.0842 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0783 - val_loss: 0.0841 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0771 - val_loss: 0.0838 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0778 - val_loss: 0.0838 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0765 - val_loss: 0.0836 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0774 - val_loss: 0.0836 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0766 - val_loss: 0.0835 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0766 - val_loss: 0.0835 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0771 - val_loss: 0.0835 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0762 - val_loss: 0.0834 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0779 - val_loss: 0.0834 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0770 - val_loss: 0.0834 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0756 - val_loss: 0.0834 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0771 - val_loss: 0.0834 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0775 - val_loss: 0.0834 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0769 - val_loss: 0.0834 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0763 - val_loss: 0.0834 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0765 - val_loss: 0.0834 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0754 - val_loss: 0.0834 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0768 - val_loss: 0.0834 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0775 - val_loss: 0.0834 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0776 - val_loss: 0.0834 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0772 - val_loss: 0.0834 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0760 - val_loss: 0.0834 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0775 - val_loss: 0.0834 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0770 - val_loss: 0.0834 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0777 - val_loss: 0.0834 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0778 - val_loss: 0.0834 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0770 - val_loss: 0.0834 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0763 - val_loss: 0.0834 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0768 - val_loss: 0.0834 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0768 - val_loss: 0.0834 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0765 - val_loss: 0.0834 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0757 - val_loss: 0.0834 - lr: 2.2897e-14
Average Validation Loss: 0.10248724967241288
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 72ms/step - loss: 0.1692 - val_loss: 0.1775 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1595 - val_loss: 0.1691 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1505 - val_loss: 0.1601 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1459 - val_loss: 0.1586 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1391 - val_loss: 0.1546 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1348 - val_loss: 0.1466 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1292 - val_loss: 0.1442 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1228 - val_loss: 0.1402 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1210 - val_loss: 0.1404 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1158 - val_loss: 0.1338 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1090 - val_loss: 0.1318 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 25ms/step - loss: 0.1064 - val_loss: 0.1291 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 25ms/step - loss: 0.1047 - val_loss: 0.1261 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0993 - val_loss: 0.1239 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0927 - val_loss: 0.1291 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0996 - val_loss: 0.1201 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0861 - val_loss: 0.1235 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0874 - val_loss: 0.1182 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0809 - val_loss: 0.1177 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0806 - val_loss: 0.1176 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0800 - val_loss: 0.1141 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0778 - val_loss: 0.1144 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0776 - val_loss: 0.1157 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0763 - val_loss: 0.1116 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0767 - val_loss: 0.1135 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0752 - val_loss: 0.1144 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0751 - val_loss: 0.1113 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0716 - val_loss: 0.1130 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0741 - val_loss: 0.1125 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0713 - val_loss: 0.1111 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0710 - val_loss: 0.1119 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0738 - val_loss: 0.1118 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0730 - val_loss: 0.1111 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0734 - val_loss: 0.1109 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0731 - val_loss: 0.1111 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0756 - val_loss: 0.1113 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0710 - val_loss: 0.1116 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0712 - val_loss: 0.1118 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0715 - val_loss: 0.1119 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0701 - val_loss: 0.1118 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0719 - val_loss: 0.1118 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0735 - val_loss: 0.1119 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0735 - val_loss: 0.1119 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0729 - val_loss: 0.1119 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0722 - val_loss: 0.1119 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0722 - val_loss: 0.1119 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0723 - val_loss: 0.1119 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0734 - val_loss: 0.1119 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0730 - val_loss: 0.1119 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0731 - val_loss: 0.1119 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0731 - val_loss: 0.1119 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0742 - val_loss: 0.1119 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0718 - val_loss: 0.1119 - lr: 1.0130e-08
Epoch 54/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0722 - val_loss: 0.1119 - lr: 6.1442e-09
Epoch 1/100
34/34 [==============================] - 5s 53ms/step - loss: 0.1896 - val_loss: 0.1212 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1749 - val_loss: 0.1152 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1619 - val_loss: 0.1156 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1576 - val_loss: 0.1074 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1503 - val_loss: 0.1010 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1414 - val_loss: 0.0994 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1381 - val_loss: 0.1098 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1317 - val_loss: 0.0910 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1254 - val_loss: 0.1171 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1182 - val_loss: 0.1050 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1187 - val_loss: 0.0951 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1105 - val_loss: 0.1032 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1072 - val_loss: 0.0949 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1028 - val_loss: 0.1002 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0969 - val_loss: 0.1043 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0919 - val_loss: 0.1049 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0874 - val_loss: 0.0988 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0868 - val_loss: 0.0963 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0845 - val_loss: 0.0918 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0835 - val_loss: 0.0879 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0802 - val_loss: 0.0895 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0792 - val_loss: 0.0892 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0768 - val_loss: 0.0882 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0757 - val_loss: 0.0900 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0744 - val_loss: 0.0922 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0735 - val_loss: 0.0898 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0728 - val_loss: 0.0904 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0734 - val_loss: 0.0916 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0725 - val_loss: 0.0920 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0730 - val_loss: 0.0897 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0712 - val_loss: 0.0893 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0721 - val_loss: 0.0905 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0698 - val_loss: 0.0911 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0727 - val_loss: 0.0910 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0719 - val_loss: 0.0911 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0706 - val_loss: 0.0906 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0703 - val_loss: 0.0903 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0731 - val_loss: 0.0903 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0712 - val_loss: 0.0903 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0722 - val_loss: 0.0904 - lr: 2.4788e-06
Epoch 1/100
51/51 [==============================] - 5s 32ms/step - loss: 0.1659 - val_loss: 0.1581 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1459 - val_loss: 0.1431 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1376 - val_loss: 0.1299 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1301 - val_loss: 0.1208 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1254 - val_loss: 0.1157 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1201 - val_loss: 0.1099 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1156 - val_loss: 0.1048 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1119 - val_loss: 0.1029 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1086 - val_loss: 0.0964 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1034 - val_loss: 0.0966 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0980 - val_loss: 0.0869 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0926 - val_loss: 0.0870 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0882 - val_loss: 0.0809 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0830 - val_loss: 0.0731 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0767 - val_loss: 0.0696 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0747 - val_loss: 0.0680 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0717 - val_loss: 0.0663 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0680 - val_loss: 0.0641 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0686 - val_loss: 0.0642 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0678 - val_loss: 0.0626 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0657 - val_loss: 0.0631 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0669 - val_loss: 0.0619 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0658 - val_loss: 0.0620 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0655 - val_loss: 0.0616 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0673 - val_loss: 0.0632 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0652 - val_loss: 0.0640 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0656 - val_loss: 0.0648 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0641 - val_loss: 0.0655 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0633 - val_loss: 0.0657 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0623 - val_loss: 0.0650 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0619 - val_loss: 0.0662 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0625 - val_loss: 0.0660 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0623 - val_loss: 0.0666 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0669 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0667 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0666 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0667 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0666 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0664 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0665 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0613 - val_loss: 0.0665 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0615 - val_loss: 0.0665 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0616 - val_loss: 0.0665 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0624 - val_loss: 0.0665 - lr: 5.0045e-07
Epoch 1/100
68/68 [==============================] - 5s 28ms/step - loss: 0.1680 - val_loss: 0.1571 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1499 - val_loss: 0.1381 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1345 - val_loss: 0.1331 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1236 - val_loss: 0.1278 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1181 - val_loss: 0.1106 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1097 - val_loss: 0.1003 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1052 - val_loss: 0.0994 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1062 - val_loss: 0.1017 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1011 - val_loss: 0.0916 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0939 - val_loss: 0.0955 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0880 - val_loss: 0.0878 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0835 - val_loss: 0.0881 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0784 - val_loss: 0.0956 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0770 - val_loss: 0.0917 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0747 - val_loss: 0.0826 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0730 - val_loss: 0.0766 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0702 - val_loss: 0.0752 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0702 - val_loss: 0.0676 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0669 - val_loss: 0.0669 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0665 - val_loss: 0.0659 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0646 - val_loss: 0.0653 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0639 - val_loss: 0.0656 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0630 - val_loss: 0.0649 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0620 - val_loss: 0.0647 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0609 - val_loss: 0.0668 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0612 - val_loss: 0.0626 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0622 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0600 - val_loss: 0.0603 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0598 - val_loss: 0.0585 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0592 - val_loss: 0.0579 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0588 - val_loss: 0.0569 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0593 - val_loss: 0.0567 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0566 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0587 - val_loss: 0.0565 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0582 - val_loss: 0.0565 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0564 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0564 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0570 - val_loss: 0.0564 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0563 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0563 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0563 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0584 - val_loss: 0.0563 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0580 - val_loss: 0.0563 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0571 - val_loss: 0.0563 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0576 - val_loss: 0.0563 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0585 - val_loss: 0.0563 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0579 - val_loss: 0.0563 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0583 - val_loss: 0.0563 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0585 - val_loss: 0.0563 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0563 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0579 - val_loss: 0.0563 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0563 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0581 - val_loss: 0.0563 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0563 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0563 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0576 - val_loss: 0.0563 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0563 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0574 - val_loss: 0.0563 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0585 - val_loss: 0.0563 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0580 - val_loss: 0.0563 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0573 - val_loss: 0.0563 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0563 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0569 - val_loss: 0.0563 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0576 - val_loss: 0.0563 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 5s 25ms/step - loss: 0.1625 - val_loss: 0.1370 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 18ms/step - loss: 0.1385 - val_loss: 0.1216 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 19ms/step - loss: 0.1231 - val_loss: 0.1127 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1117 - val_loss: 0.1046 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1043 - val_loss: 0.1006 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1024 - val_loss: 0.0990 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1039 - val_loss: 0.0968 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0884 - val_loss: 0.0948 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0889 - val_loss: 0.0923 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0826 - val_loss: 0.0919 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0796 - val_loss: 0.0824 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0755 - val_loss: 0.0778 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0739 - val_loss: 0.0769 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0744 - val_loss: 0.0736 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0722 - val_loss: 0.0724 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0692 - val_loss: 0.0736 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0687 - val_loss: 0.0720 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0643 - val_loss: 0.0714 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0646 - val_loss: 0.0689 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0672 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0593 - val_loss: 0.0664 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0581 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0562 - val_loss: 0.0645 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0550 - val_loss: 0.0645 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0539 - val_loss: 0.0649 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0529 - val_loss: 0.0624 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0534 - val_loss: 0.0638 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0514 - val_loss: 0.0637 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0525 - val_loss: 0.0643 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0631 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0509 - val_loss: 0.0631 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0515 - val_loss: 0.0631 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0629 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0512 - val_loss: 0.0629 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0625 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0627 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0515 - val_loss: 0.0627 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0510 - val_loss: 0.0627 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0626 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0496 - val_loss: 0.0626 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0502 - val_loss: 0.0626 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0500 - val_loss: 0.0626 - lr: 2.2487e-07
Average Validation Loss: 0.07583767175674438
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 120ms/step - loss: 0.1663 - val_loss: 0.1664 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1536 - val_loss: 0.1838 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1567 - val_loss: 0.1699 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1492 - val_loss: 0.1582 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1428 - val_loss: 0.1572 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1377 - val_loss: 0.1575 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1341 - val_loss: 0.1545 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1363 - val_loss: 0.1438 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1242 - val_loss: 0.1404 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1159 - val_loss: 0.1452 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1175 - val_loss: 0.1323 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1048 - val_loss: 0.1348 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1028 - val_loss: 0.1271 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0956 - val_loss: 0.1433 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0931 - val_loss: 0.1235 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0903 - val_loss: 0.1387 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0904 - val_loss: 0.1216 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0840 - val_loss: 0.1431 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0860 - val_loss: 0.1222 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.1360 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0849 - val_loss: 0.1235 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0826 - val_loss: 0.1305 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0827 - val_loss: 0.1268 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0812 - val_loss: 0.1265 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0828 - val_loss: 0.1236 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0808 - val_loss: 0.1243 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0797 - val_loss: 0.1250 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0814 - val_loss: 0.1276 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0816 - val_loss: 0.1276 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0819 - val_loss: 0.1258 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0818 - val_loss: 0.1254 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0809 - val_loss: 0.1252 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0820 - val_loss: 0.1250 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0808 - val_loss: 0.1252 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0807 - val_loss: 0.1257 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0818 - val_loss: 0.1257 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0820 - val_loss: 0.1255 - lr: 6.0967e-06
Epoch 1/100
17/17 [==============================] - 4s 66ms/step - loss: 0.1867 - val_loss: 0.1318 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1689 - val_loss: 0.1260 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1615 - val_loss: 0.1231 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1567 - val_loss: 0.1175 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1478 - val_loss: 0.1107 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1404 - val_loss: 0.1053 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1300 - val_loss: 0.1015 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1291 - val_loss: 0.0948 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1272 - val_loss: 0.0949 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1137 - val_loss: 0.0922 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1067 - val_loss: 0.0938 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1017 - val_loss: 0.0905 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0968 - val_loss: 0.0909 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0947 - val_loss: 0.0940 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0911 - val_loss: 0.0927 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0884 - val_loss: 0.0882 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0876 - val_loss: 0.0916 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0849 - val_loss: 0.0861 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0847 - val_loss: 0.0888 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0838 - val_loss: 0.0913 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0839 - val_loss: 0.0881 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0828 - val_loss: 0.0908 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0806 - val_loss: 0.0885 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0813 - val_loss: 0.0915 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0814 - val_loss: 0.0887 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0798 - val_loss: 0.0866 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0787 - val_loss: 0.0898 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0806 - val_loss: 0.0891 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0794 - val_loss: 0.0878 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0804 - val_loss: 0.0898 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0797 - val_loss: 0.0886 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0792 - val_loss: 0.0899 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0804 - val_loss: 0.0900 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0797 - val_loss: 0.0896 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0789 - val_loss: 0.0896 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0783 - val_loss: 0.0895 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0795 - val_loss: 0.0893 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0792 - val_loss: 0.0893 - lr: 4.5166e-06
Epoch 1/100
26/26 [==============================] - 5s 69ms/step - loss: 0.1842 - val_loss: 0.1631 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1530 - val_loss: 0.1570 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1434 - val_loss: 0.1426 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1361 - val_loss: 0.1303 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1305 - val_loss: 0.1185 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1249 - val_loss: 0.1115 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1176 - val_loss: 0.1097 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1127 - val_loss: 0.1070 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1086 - val_loss: 0.1028 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 26ms/step - loss: 0.1057 - val_loss: 0.0969 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0990 - val_loss: 0.0942 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0948 - val_loss: 0.0875 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0907 - val_loss: 0.0883 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0895 - val_loss: 0.0852 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0871 - val_loss: 0.0826 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0861 - val_loss: 0.0814 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0873 - val_loss: 0.0793 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0865 - val_loss: 0.0765 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0907 - val_loss: 0.0816 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0865 - val_loss: 0.0863 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0824 - val_loss: 0.0834 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0818 - val_loss: 0.0826 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0798 - val_loss: 0.0807 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0779 - val_loss: 0.0774 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0786 - val_loss: 0.0803 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0786 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0763 - val_loss: 0.0777 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0760 - val_loss: 0.0776 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0749 - val_loss: 0.0771 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0750 - val_loss: 0.0773 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.0760 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0763 - val_loss: 0.0763 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0740 - val_loss: 0.0766 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.0766 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0757 - val_loss: 0.0767 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0758 - val_loss: 0.0769 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0744 - val_loss: 0.0768 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0747 - val_loss: 0.0767 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0755 - val_loss: 0.0766 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0747 - val_loss: 0.0766 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0759 - val_loss: 0.0766 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0746 - val_loss: 0.0767 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0748 - val_loss: 0.0766 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0750 - val_loss: 0.0767 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0761 - val_loss: 0.0767 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0736 - val_loss: 0.0767 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0750 - val_loss: 0.0766 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0754 - val_loss: 0.0766 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0759 - val_loss: 0.0766 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0749 - val_loss: 0.0766 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0744 - val_loss: 0.0766 - lr: 2.7536e-08
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1951 - val_loss: 0.1562 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1581 - val_loss: 0.1434 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1410 - val_loss: 0.1453 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1317 - val_loss: 0.1418 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1240 - val_loss: 0.1275 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1159 - val_loss: 0.1167 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1073 - val_loss: 0.1104 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1015 - val_loss: 0.0986 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0953 - val_loss: 0.0960 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0949 - val_loss: 0.0873 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0908 - val_loss: 0.0873 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0883 - val_loss: 0.0844 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0833 - val_loss: 0.0866 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0811 - val_loss: 0.0810 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0813 - val_loss: 0.0827 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0802 - val_loss: 0.0887 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0790 - val_loss: 0.0828 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0774 - val_loss: 0.0864 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0779 - val_loss: 0.0924 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0775 - val_loss: 0.0917 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0783 - val_loss: 0.0966 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0838 - val_loss: 0.0935 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0856 - val_loss: 0.0770 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0790 - val_loss: 0.0715 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0746 - val_loss: 0.0695 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0742 - val_loss: 0.0658 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0723 - val_loss: 0.0656 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0719 - val_loss: 0.0629 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0699 - val_loss: 0.0632 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0707 - val_loss: 0.0632 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0699 - val_loss: 0.0625 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0710 - val_loss: 0.0617 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0621 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0692 - val_loss: 0.0621 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0695 - val_loss: 0.0620 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0695 - val_loss: 0.0619 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0688 - val_loss: 0.0619 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0693 - val_loss: 0.0619 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0703 - val_loss: 0.0619 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0692 - val_loss: 0.0618 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0681 - val_loss: 0.0618 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0699 - val_loss: 0.0618 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0703 - val_loss: 0.0618 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0694 - val_loss: 0.0618 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0689 - val_loss: 0.0618 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0697 - val_loss: 0.0618 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0692 - val_loss: 0.0618 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0698 - val_loss: 0.0618 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0690 - val_loss: 0.0618 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0704 - val_loss: 0.0618 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0689 - val_loss: 0.0618 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0699 - val_loss: 0.0618 - lr: 1.6702e-08
Epoch 1/100
43/43 [==============================] - 4s 39ms/step - loss: 0.1692 - val_loss: 0.1486 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 22ms/step - loss: 0.1462 - val_loss: 0.1344 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1325 - val_loss: 0.1252 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1192 - val_loss: 0.1162 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1112 - val_loss: 0.1107 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1036 - val_loss: 0.1057 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0975 - val_loss: 0.1026 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0931 - val_loss: 0.0972 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0861 - val_loss: 0.0949 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0839 - val_loss: 0.0940 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0812 - val_loss: 0.0979 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0854 - val_loss: 0.0884 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0789 - val_loss: 0.0844 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0761 - val_loss: 0.0820 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0730 - val_loss: 0.0803 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0685 - val_loss: 0.0777 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0674 - val_loss: 0.0767 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0668 - val_loss: 0.0746 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0651 - val_loss: 0.0728 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0633 - val_loss: 0.0721 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0618 - val_loss: 0.0712 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0618 - val_loss: 0.0716 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0613 - val_loss: 0.0710 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0602 - val_loss: 0.0697 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0605 - val_loss: 0.0700 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0603 - val_loss: 0.0692 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0597 - val_loss: 0.0687 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0606 - val_loss: 0.0682 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0608 - val_loss: 0.0674 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0670 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0666 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0586 - val_loss: 0.0663 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0582 - val_loss: 0.0663 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0590 - val_loss: 0.0661 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0581 - val_loss: 0.0661 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0584 - val_loss: 0.0661 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0588 - val_loss: 0.0660 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0585 - val_loss: 0.0660 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0579 - val_loss: 0.0660 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0590 - val_loss: 0.0659 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0581 - val_loss: 0.0659 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0659 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0577 - val_loss: 0.0659 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0659 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0588 - val_loss: 0.0659 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0576 - val_loss: 0.0659 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0575 - val_loss: 0.0659 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0659 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0579 - val_loss: 0.0659 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0576 - val_loss: 0.0659 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0578 - val_loss: 0.0659 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0587 - val_loss: 0.0659 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0659 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0578 - val_loss: 0.0659 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0584 - val_loss: 0.0659 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0582 - val_loss: 0.0659 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0593 - val_loss: 0.0659 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0581 - val_loss: 0.0659 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0573 - val_loss: 0.0659 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0582 - val_loss: 0.0659 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 9.2853e-14
Average Validation Loss: 0.0822853147983551
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 229ms/step - loss: 0.2118 - val_loss: 0.1796 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1614 - val_loss: 0.1842 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1666 - val_loss: 0.1920 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1676 - val_loss: 0.1922 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1638 - val_loss: 0.1866 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1606 - val_loss: 0.1794 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1541 - val_loss: 0.1733 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1497 - val_loss: 0.1688 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1467 - val_loss: 0.1656 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1437 - val_loss: 0.1631 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1364 - val_loss: 0.1622 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1332 - val_loss: 0.1605 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1349 - val_loss: 0.1575 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1301 - val_loss: 0.1539 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1318 - val_loss: 0.1512 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1242 - val_loss: 0.1500 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1239 - val_loss: 0.1486 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1209 - val_loss: 0.1468 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1176 - val_loss: 0.1438 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1157 - val_loss: 0.1415 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1154 - val_loss: 0.1409 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1143 - val_loss: 0.1398 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1110 - val_loss: 0.1391 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1144 - val_loss: 0.1383 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1069 - val_loss: 0.1378 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1081 - val_loss: 0.1376 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1062 - val_loss: 0.1376 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1120 - val_loss: 0.1377 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1099 - val_loss: 0.1376 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1092 - val_loss: 0.1372 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 49ms/step - loss: 0.1037 - val_loss: 0.1368 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1078 - val_loss: 0.1366 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1118 - val_loss: 0.1364 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1078 - val_loss: 0.1363 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1069 - val_loss: 0.1362 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1071 - val_loss: 0.1362 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1071 - val_loss: 0.1361 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1070 - val_loss: 0.1361 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1060 - val_loss: 0.1361 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1073 - val_loss: 0.1361 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1061 - val_loss: 0.1361 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1101 - val_loss: 0.1361 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1045 - val_loss: 0.1361 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1080 - val_loss: 0.1361 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1074 - val_loss: 0.1361 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1074 - val_loss: 0.1361 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1072 - val_loss: 0.1361 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1071 - val_loss: 0.1361 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1056 - val_loss: 0.1361 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1046 - val_loss: 0.1361 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1073 - val_loss: 0.1361 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1091 - val_loss: 0.1361 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1090 - val_loss: 0.1361 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1063 - val_loss: 0.1361 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1064 - val_loss: 0.1361 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1068 - val_loss: 0.1361 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1063 - val_loss: 0.1361 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1067 - val_loss: 0.1361 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1076 - val_loss: 0.1361 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1092 - val_loss: 0.1361 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1078 - val_loss: 0.1361 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1079 - val_loss: 0.1361 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1038 - val_loss: 0.1361 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1066 - val_loss: 0.1361 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1095 - val_loss: 0.1361 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1066 - val_loss: 0.1361 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1087 - val_loss: 0.1361 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1083 - val_loss: 0.1361 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1082 - val_loss: 0.1361 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1097 - val_loss: 0.1361 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1071 - val_loss: 0.1361 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1092 - val_loss: 0.1361 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1063 - val_loss: 0.1361 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1091 - val_loss: 0.1361 - lr: 4.6110e-14
Epoch 75/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1066 - val_loss: 0.1361 - lr: 2.2897e-14
Epoch 1/100
9/9 [==============================] - 4s 126ms/step - loss: 0.1895 - val_loss: 0.1315 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1770 - val_loss: 0.1262 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1698 - val_loss: 0.1255 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1603 - val_loss: 0.1220 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1572 - val_loss: 0.1172 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1519 - val_loss: 0.1138 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1442 - val_loss: 0.1216 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1385 - val_loss: 0.1111 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1326 - val_loss: 0.1350 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1272 - val_loss: 0.1205 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 47ms/step - loss: 0.1234 - val_loss: 0.1237 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 53ms/step - loss: 0.1166 - val_loss: 0.1223 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1153 - val_loss: 0.1256 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1119 - val_loss: 0.1228 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1102 - val_loss: 0.1194 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1081 - val_loss: 0.1184 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1069 - val_loss: 0.1189 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1042 - val_loss: 0.1162 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1035 - val_loss: 0.1142 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1043 - val_loss: 0.1170 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1035 - val_loss: 0.1119 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1011 - val_loss: 0.1131 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0995 - val_loss: 0.1144 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1001 - val_loss: 0.1121 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0998 - val_loss: 0.1101 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1002 - val_loss: 0.1101 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0980 - val_loss: 0.1079 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0983 - val_loss: 0.1073 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0992 - val_loss: 0.1107 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0990 - val_loss: 0.1134 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0983 - val_loss: 0.1130 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0972 - val_loss: 0.1120 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1002 - val_loss: 0.1115 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0993 - val_loss: 0.1113 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1000 - val_loss: 0.1111 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0985 - val_loss: 0.1109 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1002 - val_loss: 0.1108 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0980 - val_loss: 0.1108 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0972 - val_loss: 0.1107 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0986 - val_loss: 0.1106 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0992 - val_loss: 0.1106 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0996 - val_loss: 0.1107 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0970 - val_loss: 0.1107 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0999 - val_loss: 0.1107 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1009 - val_loss: 0.1107 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0996 - val_loss: 0.1107 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0994 - val_loss: 0.1107 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0995 - val_loss: 0.1107 - lr: 1.0104e-07
Epoch 1/100
13/13 [==============================] - 4s 86ms/step - loss: 0.2021 - val_loss: 0.1918 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1696 - val_loss: 0.1717 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1632 - val_loss: 0.1675 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1523 - val_loss: 0.1555 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1428 - val_loss: 0.1424 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1379 - val_loss: 0.1298 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1304 - val_loss: 0.1217 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1228 - val_loss: 0.1112 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1243 - val_loss: 0.1075 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1137 - val_loss: 0.0972 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1106 - val_loss: 0.0902 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1071 - val_loss: 0.0879 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0995 - val_loss: 0.0875 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0961 - val_loss: 0.0840 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0929 - val_loss: 0.0799 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0898 - val_loss: 0.0796 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0874 - val_loss: 0.0760 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0879 - val_loss: 0.0760 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0881 - val_loss: 0.0773 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0864 - val_loss: 0.0788 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0840 - val_loss: 0.0759 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0829 - val_loss: 0.0742 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0825 - val_loss: 0.0740 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0817 - val_loss: 0.0739 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0814 - val_loss: 0.0753 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0737 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0802 - val_loss: 0.0748 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0803 - val_loss: 0.0738 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0813 - val_loss: 0.0733 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0793 - val_loss: 0.0729 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0812 - val_loss: 0.0729 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0815 - val_loss: 0.0728 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0805 - val_loss: 0.0733 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0811 - val_loss: 0.0736 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0818 - val_loss: 0.0737 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0791 - val_loss: 0.0736 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0809 - val_loss: 0.0737 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0796 - val_loss: 0.0738 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0798 - val_loss: 0.0738 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0795 - val_loss: 0.0738 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0802 - val_loss: 0.0739 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0792 - val_loss: 0.0739 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0792 - val_loss: 0.0738 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0806 - val_loss: 0.0738 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0805 - val_loss: 0.0738 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0806 - val_loss: 0.0738 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0797 - val_loss: 0.0738 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0803 - val_loss: 0.0738 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0809 - val_loss: 0.0738 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0800 - val_loss: 0.0738 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0810 - val_loss: 0.0738 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0808 - val_loss: 0.0738 - lr: 1.6702e-08
Epoch 1/100
17/17 [==============================] - 4s 72ms/step - loss: 0.2160 - val_loss: 0.1550 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1600 - val_loss: 0.1544 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1525 - val_loss: 0.1403 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1399 - val_loss: 0.1391 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1359 - val_loss: 0.1372 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1265 - val_loss: 0.1377 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1223 - val_loss: 0.1328 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1185 - val_loss: 0.1243 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1131 - val_loss: 0.1262 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1114 - val_loss: 0.1171 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1072 - val_loss: 0.1089 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1026 - val_loss: 0.1021 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0989 - val_loss: 0.0977 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0948 - val_loss: 0.0978 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0938 - val_loss: 0.0963 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0923 - val_loss: 0.0898 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0900 - val_loss: 0.0895 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0895 - val_loss: 0.0855 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0878 - val_loss: 0.0872 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0881 - val_loss: 0.0794 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0848 - val_loss: 0.0786 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0842 - val_loss: 0.0752 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0816 - val_loss: 0.0744 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0824 - val_loss: 0.0740 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0828 - val_loss: 0.0732 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0818 - val_loss: 0.0725 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0811 - val_loss: 0.0719 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0813 - val_loss: 0.0722 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0814 - val_loss: 0.0720 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0801 - val_loss: 0.0719 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0813 - val_loss: 0.0710 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0809 - val_loss: 0.0709 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0817 - val_loss: 0.0711 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0802 - val_loss: 0.0710 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0799 - val_loss: 0.0709 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0799 - val_loss: 0.0707 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0809 - val_loss: 0.0707 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0799 - val_loss: 0.0707 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0804 - val_loss: 0.0706 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0812 - val_loss: 0.0706 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0798 - val_loss: 0.0707 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0806 - val_loss: 0.0707 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0807 - val_loss: 0.0707 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0794 - val_loss: 0.0707 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0803 - val_loss: 0.0707 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0805 - val_loss: 0.0707 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0804 - val_loss: 0.0707 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0803 - val_loss: 0.0707 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0801 - val_loss: 0.0707 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0805 - val_loss: 0.0707 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0799 - val_loss: 0.0707 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0804 - val_loss: 0.0707 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0790 - val_loss: 0.0707 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0809 - val_loss: 0.0707 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0805 - val_loss: 0.0707 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0817 - val_loss: 0.0707 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0798 - val_loss: 0.0707 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0803 - val_loss: 0.0707 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0814 - val_loss: 0.0707 - lr: 5.0435e-10
Epoch 1/100
22/22 [==============================] - 5s 70ms/step - loss: 0.2054 - val_loss: 0.1541 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1627 - val_loss: 0.1469 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1505 - val_loss: 0.1429 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1411 - val_loss: 0.1351 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1340 - val_loss: 0.1327 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1288 - val_loss: 0.1264 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1247 - val_loss: 0.1234 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1198 - val_loss: 0.1219 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1183 - val_loss: 0.1229 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1148 - val_loss: 0.1168 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1084 - val_loss: 0.1125 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1041 - val_loss: 0.1131 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1033 - val_loss: 0.1122 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1030 - val_loss: 0.1127 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0984 - val_loss: 0.1048 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0929 - val_loss: 0.1050 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0903 - val_loss: 0.1031 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0875 - val_loss: 0.1003 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0855 - val_loss: 0.0995 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0837 - val_loss: 0.0976 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0834 - val_loss: 0.0935 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0804 - val_loss: 0.0890 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0777 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0764 - val_loss: 0.0845 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0747 - val_loss: 0.0832 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0743 - val_loss: 0.0823 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0738 - val_loss: 0.0819 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0736 - val_loss: 0.0814 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0730 - val_loss: 0.0810 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0731 - val_loss: 0.0808 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0735 - val_loss: 0.0806 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0805 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0718 - val_loss: 0.0804 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0804 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0735 - val_loss: 0.0803 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0803 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0725 - val_loss: 0.0802 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0734 - val_loss: 0.0802 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0730 - val_loss: 0.0802 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0734 - val_loss: 0.0802 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0728 - val_loss: 0.0802 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0712 - val_loss: 0.0802 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0733 - val_loss: 0.0802 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0728 - val_loss: 0.0802 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0727 - val_loss: 0.0802 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0731 - val_loss: 0.0802 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0740 - val_loss: 0.0802 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0802 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0727 - val_loss: 0.0802 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0732 - val_loss: 0.0802 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0730 - val_loss: 0.0802 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0726 - val_loss: 0.0802 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0726 - val_loss: 0.0802 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0729 - val_loss: 0.0802 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0727 - val_loss: 0.0802 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0730 - val_loss: 0.0802 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0734 - val_loss: 0.0802 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0719 - val_loss: 0.0802 - lr: 4.6110e-14
Average Validation Loss: 0.09341935217380523
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 67ms/step - loss: 0.1322 - val_loss: 0.1343 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1142 - val_loss: 0.1300 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1116 - val_loss: 0.1240 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1081 - val_loss: 0.1169 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0909 - val_loss: 0.1269 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0998 - val_loss: 0.1106 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0822 - val_loss: 0.1125 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0852 - val_loss: 0.1062 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0694 - val_loss: 0.1093 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0651 - val_loss: 0.1128 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0707 - val_loss: 0.1072 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0647 - val_loss: 0.1017 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0556 - val_loss: 0.0972 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0523 - val_loss: 0.1004 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0523 - val_loss: 0.0973 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0496 - val_loss: 0.1132 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0524 - val_loss: 0.0945 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0482 - val_loss: 0.1046 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0473 - val_loss: 0.0991 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0477 - val_loss: 0.0988 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0480 - val_loss: 0.0965 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0472 - val_loss: 0.0953 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0479 - val_loss: 0.1003 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0481 - val_loss: 0.0994 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0465 - val_loss: 0.1003 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0462 - val_loss: 0.0995 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0459 - val_loss: 0.0948 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 37ms/step - loss: 0.0455 - val_loss: 0.1005 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0450 - val_loss: 0.0994 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0478 - val_loss: 0.0985 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0444 - val_loss: 0.0982 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0459 - val_loss: 0.0992 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0447 - val_loss: 0.0988 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0466 - val_loss: 0.0986 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0456 - val_loss: 0.0985 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0457 - val_loss: 0.0985 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0454 - val_loss: 0.0986 - lr: 6.0967e-06
Epoch 1/100
34/34 [==============================] - 4s 47ms/step - loss: 0.1335 - val_loss: 0.0687 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1270 - val_loss: 0.0752 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1195 - val_loss: 0.0686 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1197 - val_loss: 0.0687 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1129 - val_loss: 0.0659 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1075 - val_loss: 0.0765 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1067 - val_loss: 0.0671 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1047 - val_loss: 0.0683 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1005 - val_loss: 0.0877 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0979 - val_loss: 0.0631 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0945 - val_loss: 0.0765 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0857 - val_loss: 0.0836 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0854 - val_loss: 0.0726 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0839 - val_loss: 0.0677 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0802 - val_loss: 0.0686 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0748 - val_loss: 0.0645 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0716 - val_loss: 0.0700 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0662 - val_loss: 0.0670 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0656 - val_loss: 0.0602 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0646 - val_loss: 0.0591 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0621 - val_loss: 0.0633 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0620 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0585 - val_loss: 0.0620 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0577 - val_loss: 0.0655 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0570 - val_loss: 0.0638 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0573 - val_loss: 0.0659 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0568 - val_loss: 0.0650 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0524 - val_loss: 0.0671 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0539 - val_loss: 0.0666 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0552 - val_loss: 0.0662 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0534 - val_loss: 0.0658 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0542 - val_loss: 0.0673 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0550 - val_loss: 0.0665 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0533 - val_loss: 0.0669 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0557 - val_loss: 0.0669 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0543 - val_loss: 0.0667 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0530 - val_loss: 0.0669 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0542 - val_loss: 0.0670 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0531 - val_loss: 0.0668 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0536 - val_loss: 0.0667 - lr: 2.4788e-06
Epoch 1/100
51/51 [==============================] - 5s 33ms/step - loss: 0.1326 - val_loss: 0.1147 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1133 - val_loss: 0.1058 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1091 - val_loss: 0.0994 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1034 - val_loss: 0.0949 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0989 - val_loss: 0.0900 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0951 - val_loss: 0.0912 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0982 - val_loss: 0.0890 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0894 - val_loss: 0.0859 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0864 - val_loss: 0.0769 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0886 - val_loss: 0.0796 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0782 - val_loss: 0.0748 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0733 - val_loss: 0.0731 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0715 - val_loss: 0.0694 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0673 - val_loss: 0.0671 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0661 - val_loss: 0.0653 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0639 - val_loss: 0.0631 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0622 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0624 - val_loss: 0.0629 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0612 - val_loss: 0.0614 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0621 - val_loss: 0.0613 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0587 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0627 - val_loss: 0.0550 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0605 - val_loss: 0.0544 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0540 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0539 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0552 - val_loss: 0.0539 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0569 - val_loss: 0.0552 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0543 - val_loss: 0.0542 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0548 - val_loss: 0.0548 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0542 - val_loss: 0.0543 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0528 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0524 - val_loss: 0.0540 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0531 - val_loss: 0.0542 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0525 - val_loss: 0.0541 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0534 - val_loss: 0.0544 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0521 - val_loss: 0.0544 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0524 - val_loss: 0.0544 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0527 - val_loss: 0.0544 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0532 - val_loss: 0.0543 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0536 - val_loss: 0.0543 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0528 - val_loss: 0.0543 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0533 - val_loss: 0.0543 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0523 - val_loss: 0.0543 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0521 - val_loss: 0.0543 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0543 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 5s 28ms/step - loss: 0.1303 - val_loss: 0.1195 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1156 - val_loss: 0.1156 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1083 - val_loss: 0.1033 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1030 - val_loss: 0.0989 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0959 - val_loss: 0.0923 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0902 - val_loss: 0.0989 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0888 - val_loss: 0.0881 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0816 - val_loss: 0.0918 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0772 - val_loss: 0.0899 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0753 - val_loss: 0.0959 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0734 - val_loss: 0.0889 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0704 - val_loss: 0.0772 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0660 - val_loss: 0.0778 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0645 - val_loss: 0.0759 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0638 - val_loss: 0.0722 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0617 - val_loss: 0.0734 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0728 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0575 - val_loss: 0.0744 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0587 - val_loss: 0.0739 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0721 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0723 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0568 - val_loss: 0.0721 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0566 - val_loss: 0.0741 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0568 - val_loss: 0.0692 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0653 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0552 - val_loss: 0.0651 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0550 - val_loss: 0.0612 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0537 - val_loss: 0.0594 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0534 - val_loss: 0.0578 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0538 - val_loss: 0.0567 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0524 - val_loss: 0.0561 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0559 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0525 - val_loss: 0.0555 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0554 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0505 - val_loss: 0.0551 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0550 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0549 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0506 - val_loss: 0.0548 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0548 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0548 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0518 - val_loss: 0.0548 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0548 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0548 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0513 - val_loss: 0.0548 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0548 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0499 - val_loss: 0.0548 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0508 - val_loss: 0.0548 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0523 - val_loss: 0.0548 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0519 - val_loss: 0.0548 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0511 - val_loss: 0.0548 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0548 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0517 - val_loss: 0.0548 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0506 - val_loss: 0.0548 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0506 - val_loss: 0.0548 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0499 - val_loss: 0.0548 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0515 - val_loss: 0.0548 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0516 - val_loss: 0.0548 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 1.3924e-15
Epoch 1/100
85/85 [==============================] - 7s 32ms/step - loss: 0.1237 - val_loss: 0.1066 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1053 - val_loss: 0.1039 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1033 - val_loss: 0.1028 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0945 - val_loss: 0.1013 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0931 - val_loss: 0.0996 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0888 - val_loss: 0.0984 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0882 - val_loss: 0.0967 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0861 - val_loss: 0.0955 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0831 - val_loss: 0.0943 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0815 - val_loss: 0.0929 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0746 - val_loss: 0.0902 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0756 - val_loss: 0.0881 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0676 - val_loss: 0.0880 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0699 - val_loss: 0.0864 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0641 - val_loss: 0.0855 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0654 - val_loss: 0.0848 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0842 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0606 - val_loss: 0.0824 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0817 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0809 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0564 - val_loss: 0.0790 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0546 - val_loss: 0.0782 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0529 - val_loss: 0.0777 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0776 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0770 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0502 - val_loss: 0.0762 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0493 - val_loss: 0.0759 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0493 - val_loss: 0.0758 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0486 - val_loss: 0.0755 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0746 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0493 - val_loss: 0.0743 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0490 - val_loss: 0.0738 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0474 - val_loss: 0.0734 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0476 - val_loss: 0.0732 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0476 - val_loss: 0.0729 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0727 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0726 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0481 - val_loss: 0.0726 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0725 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0465 - val_loss: 0.0725 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0725 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0725 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0725 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0485 - val_loss: 0.0725 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0725 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0725 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0474 - val_loss: 0.0725 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0464 - val_loss: 0.0725 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0484 - val_loss: 0.0725 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0469 - val_loss: 0.0725 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0464 - val_loss: 0.0725 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0477 - val_loss: 0.0725 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0725 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0470 - val_loss: 0.0725 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0477 - val_loss: 0.0725 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0725 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0480 - val_loss: 0.0725 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0478 - val_loss: 0.0725 - lr: 2.8039e-15
Average Validation Loss: 0.06693153455853462
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 125ms/step - loss: 0.1562 - val_loss: 0.1349 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 22ms/step - loss: 0.1128 - val_loss: 0.1438 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1181 - val_loss: 0.1331 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1068 - val_loss: 0.1192 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0993 - val_loss: 0.1098 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0938 - val_loss: 0.1065 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0891 - val_loss: 0.1065 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0850 - val_loss: 0.1013 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0805 - val_loss: 0.0967 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0733 - val_loss: 0.0942 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0691 - val_loss: 0.0891 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0645 - val_loss: 0.0896 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0600 - val_loss: 0.0919 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0609 - val_loss: 0.0892 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0548 - val_loss: 0.0933 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0564 - val_loss: 0.0939 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0543 - val_loss: 0.0939 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0538 - val_loss: 0.0916 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0512 - val_loss: 0.0929 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0526 - val_loss: 0.0931 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0526 - val_loss: 0.0890 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0518 - val_loss: 0.0903 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0521 - val_loss: 0.0880 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0504 - val_loss: 0.0932 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0524 - val_loss: 0.0921 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0499 - val_loss: 0.0901 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0495 - val_loss: 0.0913 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0528 - val_loss: 0.0912 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0508 - val_loss: 0.0905 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0530 - val_loss: 0.0908 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0513 - val_loss: 0.0906 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0504 - val_loss: 0.0903 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0490 - val_loss: 0.0904 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0511 - val_loss: 0.0903 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0493 - val_loss: 0.0900 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0485 - val_loss: 0.0901 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0495 - val_loss: 0.0902 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0526 - val_loss: 0.0903 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0532 - val_loss: 0.0903 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0502 - val_loss: 0.0903 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0488 - val_loss: 0.0903 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0492 - val_loss: 0.0904 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0512 - val_loss: 0.0904 - lr: 7.4659e-07
Epoch 1/100
17/17 [==============================] - 4s 66ms/step - loss: 0.1380 - val_loss: 0.0905 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1272 - val_loss: 0.0869 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1218 - val_loss: 0.0811 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1175 - val_loss: 0.0732 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1176 - val_loss: 0.0750 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1109 - val_loss: 0.0829 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1075 - val_loss: 0.0653 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1010 - val_loss: 0.0881 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1005 - val_loss: 0.0730 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0983 - val_loss: 0.0734 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0875 - val_loss: 0.0941 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0808 - val_loss: 0.0936 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0822 - val_loss: 0.0765 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0799 - val_loss: 0.0713 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0759 - val_loss: 0.0774 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0703 - val_loss: 0.0889 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0697 - val_loss: 0.0877 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0691 - val_loss: 0.0851 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0671 - val_loss: 0.0859 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0680 - val_loss: 0.0755 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0666 - val_loss: 0.0796 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0656 - val_loss: 0.0785 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0645 - val_loss: 0.0822 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0641 - val_loss: 0.0782 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0640 - val_loss: 0.0847 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0641 - val_loss: 0.0799 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0648 - val_loss: 0.0761 - lr: 9.0718e-05
Epoch 1/100
26/26 [==============================] - 5s 50ms/step - loss: 0.1391 - val_loss: 0.1229 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1107 - val_loss: 0.1118 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1048 - val_loss: 0.1015 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0990 - val_loss: 0.0928 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0959 - val_loss: 0.0868 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0865 - val_loss: 0.0756 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0838 - val_loss: 0.0694 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0798 - val_loss: 0.0668 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0777 - val_loss: 0.0650 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0756 - val_loss: 0.0719 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0788 - val_loss: 0.0720 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0791 - val_loss: 0.0710 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0638 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0677 - val_loss: 0.0616 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0689 - val_loss: 0.0620 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0690 - val_loss: 0.0589 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0645 - val_loss: 0.0584 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0637 - val_loss: 0.0561 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0620 - val_loss: 0.0545 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0545 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0628 - val_loss: 0.0517 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0515 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0574 - val_loss: 0.0506 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0561 - val_loss: 0.0501 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0572 - val_loss: 0.0506 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0561 - val_loss: 0.0497 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0548 - val_loss: 0.0500 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0555 - val_loss: 0.0496 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0557 - val_loss: 0.0496 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0546 - val_loss: 0.0493 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0543 - val_loss: 0.0490 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0543 - val_loss: 0.0491 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 33ms/step - loss: 0.0540 - val_loss: 0.0491 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0551 - val_loss: 0.0491 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0549 - val_loss: 0.0491 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0544 - val_loss: 0.0490 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0542 - val_loss: 0.0491 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0549 - val_loss: 0.0490 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0545 - val_loss: 0.0490 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0536 - val_loss: 0.0490 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0538 - val_loss: 0.0490 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0535 - val_loss: 0.0490 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0549 - val_loss: 0.0490 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0534 - val_loss: 0.0490 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0545 - val_loss: 0.0490 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0538 - val_loss: 0.0490 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0544 - val_loss: 0.0490 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0526 - val_loss: 0.0490 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0530 - val_loss: 0.0490 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0552 - val_loss: 0.0490 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0541 - val_loss: 0.0490 - lr: 2.7536e-08
Epoch 1/100
34/34 [==============================] - 5s 44ms/step - loss: 0.1246 - val_loss: 0.1100 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1070 - val_loss: 0.1148 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1011 - val_loss: 0.1042 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0963 - val_loss: 0.1034 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0903 - val_loss: 0.0994 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0850 - val_loss: 0.0816 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0776 - val_loss: 0.0723 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0759 - val_loss: 0.0732 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0725 - val_loss: 0.0740 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0691 - val_loss: 0.0612 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0666 - val_loss: 0.0630 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0652 - val_loss: 0.0633 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0609 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0608 - val_loss: 0.0625 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0599 - val_loss: 0.0604 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0582 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0566 - val_loss: 0.0607 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0579 - val_loss: 0.0699 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0581 - val_loss: 0.0613 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0734 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0780 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0663 - val_loss: 0.0600 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0622 - val_loss: 0.0520 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0585 - val_loss: 0.0493 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0570 - val_loss: 0.0486 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0553 - val_loss: 0.0479 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0543 - val_loss: 0.0474 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0539 - val_loss: 0.0471 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0468 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0532 - val_loss: 0.0465 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0529 - val_loss: 0.0464 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0530 - val_loss: 0.0463 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0525 - val_loss: 0.0462 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0530 - val_loss: 0.0462 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0532 - val_loss: 0.0461 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0527 - val_loss: 0.0461 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0513 - val_loss: 0.0461 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0517 - val_loss: 0.0461 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0522 - val_loss: 0.0461 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0526 - val_loss: 0.0461 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0514 - val_loss: 0.0461 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0529 - val_loss: 0.0461 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0523 - val_loss: 0.0461 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0516 - val_loss: 0.0461 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0521 - val_loss: 0.0461 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0520 - val_loss: 0.0461 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0522 - val_loss: 0.0461 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0532 - val_loss: 0.0461 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0517 - val_loss: 0.0461 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0516 - val_loss: 0.0461 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0519 - val_loss: 0.0461 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0520 - val_loss: 0.0461 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0514 - val_loss: 0.0461 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0514 - val_loss: 0.0461 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0513 - val_loss: 0.0461 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0516 - val_loss: 0.0461 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0527 - val_loss: 0.0461 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0510 - val_loss: 0.0461 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0527 - val_loss: 0.0461 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0513 - val_loss: 0.0461 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0517 - val_loss: 0.0461 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 4.6110e-14
Epoch 1/100
43/43 [==============================] - 5s 43ms/step - loss: 0.1218 - val_loss: 0.1080 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 22ms/step - loss: 0.1124 - val_loss: 0.1059 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1037 - val_loss: 0.1045 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0965 - val_loss: 0.1035 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0931 - val_loss: 0.1027 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0877 - val_loss: 0.1020 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0840 - val_loss: 0.1003 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0802 - val_loss: 0.0985 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0770 - val_loss: 0.0971 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0772 - val_loss: 0.0944 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0748 - val_loss: 0.0924 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0702 - val_loss: 0.0900 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0674 - val_loss: 0.0891 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0646 - val_loss: 0.0873 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0613 - val_loss: 0.0864 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0608 - val_loss: 0.0851 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0602 - val_loss: 0.0829 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0584 - val_loss: 0.0821 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0569 - val_loss: 0.0822 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0573 - val_loss: 0.0806 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0553 - val_loss: 0.0791 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0550 - val_loss: 0.0790 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0538 - val_loss: 0.0784 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0539 - val_loss: 0.0781 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0545 - val_loss: 0.0780 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0537 - val_loss: 0.0773 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0559 - val_loss: 0.0772 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0552 - val_loss: 0.0765 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0538 - val_loss: 0.0755 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0535 - val_loss: 0.0749 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0523 - val_loss: 0.0745 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0525 - val_loss: 0.0743 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0516 - val_loss: 0.0741 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0739 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0507 - val_loss: 0.0738 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0514 - val_loss: 0.0738 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0514 - val_loss: 0.0737 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0517 - val_loss: 0.0737 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0519 - val_loss: 0.0737 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0514 - val_loss: 0.0737 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0737 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0518 - val_loss: 0.0736 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0520 - val_loss: 0.0736 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0515 - val_loss: 0.0736 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0521 - val_loss: 0.0736 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0510 - val_loss: 0.0736 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0515 - val_loss: 0.0736 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0736 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0521 - val_loss: 0.0736 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0520 - val_loss: 0.0736 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0508 - val_loss: 0.0736 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0736 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0736 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0514 - val_loss: 0.0736 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0501 - val_loss: 0.0736 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0513 - val_loss: 0.0736 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0518 - val_loss: 0.0736 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0517 - val_loss: 0.0736 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0517 - val_loss: 0.0736 - lr: 1.1370e-14
Average Validation Loss: 0.06438567265868186
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 213ms/step - loss: 0.1980 - val_loss: 0.1647 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1341 - val_loss: 0.1374 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1199 - val_loss: 0.1381 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1189 - val_loss: 0.1414 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1175 - val_loss: 0.1439 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1178 - val_loss: 0.1433 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1142 - val_loss: 0.1399 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1101 - val_loss: 0.1346 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1074 - val_loss: 0.1285 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1022 - val_loss: 0.1232 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0977 - val_loss: 0.1205 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0952 - val_loss: 0.1192 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0938 - val_loss: 0.1177 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0930 - val_loss: 0.1166 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0868 - val_loss: 0.1157 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0879 - val_loss: 0.1135 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0822 - val_loss: 0.1116 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0804 - val_loss: 0.1097 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 54ms/step - loss: 0.0749 - val_loss: 0.1101 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0708 - val_loss: 0.1082 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0731 - val_loss: 0.1055 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0684 - val_loss: 0.1045 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0677 - val_loss: 0.1039 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0660 - val_loss: 0.1037 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0625 - val_loss: 0.1036 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0643 - val_loss: 0.1032 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0643 - val_loss: 0.1032 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0644 - val_loss: 0.1033 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0614 - val_loss: 0.1033 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0612 - val_loss: 0.1030 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0625 - val_loss: 0.1028 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0618 - val_loss: 0.1028 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0592 - val_loss: 0.1028 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0617 - val_loss: 0.1029 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0609 - val_loss: 0.1029 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0609 - val_loss: 0.1029 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0620 - val_loss: 0.1030 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0641 - val_loss: 0.1030 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0634 - val_loss: 0.1030 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0601 - val_loss: 0.1030 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0609 - val_loss: 0.1030 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0596 - val_loss: 0.1030 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0604 - val_loss: 0.1030 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0659 - val_loss: 0.1030 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0652 - val_loss: 0.1030 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0635 - val_loss: 0.1030 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0615 - val_loss: 0.1030 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0635 - val_loss: 0.1030 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0604 - val_loss: 0.1030 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0602 - val_loss: 0.1030 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0606 - val_loss: 0.1030 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0616 - val_loss: 0.1030 - lr: 1.6702e-08
Epoch 1/100
9/9 [==============================] - 5s 255ms/step - loss: 0.1377 - val_loss: 0.0905 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1309 - val_loss: 0.0869 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1203 - val_loss: 0.0891 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1174 - val_loss: 0.0824 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1154 - val_loss: 0.0744 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1102 - val_loss: 0.0769 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1054 - val_loss: 0.0820 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1026 - val_loss: 0.0791 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0967 - val_loss: 0.0828 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0945 - val_loss: 0.0885 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0892 - val_loss: 0.0933 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0856 - val_loss: 0.0956 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0830 - val_loss: 0.0949 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0814 - val_loss: 0.0979 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0776 - val_loss: 0.1021 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0767 - val_loss: 0.0938 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0769 - val_loss: 0.1054 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0763 - val_loss: 0.1027 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0754 - val_loss: 0.1043 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0742 - val_loss: 0.0983 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0747 - val_loss: 0.1107 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0719 - val_loss: 0.0977 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0719 - val_loss: 0.1028 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0714 - val_loss: 0.1032 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0730 - val_loss: 0.1057 - lr: 1.3534e-04
Epoch 1/100
13/13 [==============================] - 4s 92ms/step - loss: 0.1317 - val_loss: 0.1255 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 23ms/step - loss: 0.1145 - val_loss: 0.1156 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1042 - val_loss: 0.1096 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0960 - val_loss: 0.0998 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0937 - val_loss: 0.0950 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0899 - val_loss: 0.0915 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0882 - val_loss: 0.0870 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0856 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0832 - val_loss: 0.0809 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0812 - val_loss: 0.0787 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0803 - val_loss: 0.0760 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0771 - val_loss: 0.0721 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0749 - val_loss: 0.0729 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0723 - val_loss: 0.0692 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0695 - val_loss: 0.0671 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0708 - val_loss: 0.0653 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0702 - val_loss: 0.0650 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0670 - val_loss: 0.0636 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0670 - val_loss: 0.0624 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0674 - val_loss: 0.0621 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0654 - val_loss: 0.0611 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0646 - val_loss: 0.0613 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0650 - val_loss: 0.0615 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0638 - val_loss: 0.0603 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0642 - val_loss: 0.0610 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0629 - val_loss: 0.0603 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0635 - val_loss: 0.0595 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0628 - val_loss: 0.0605 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0625 - val_loss: 0.0599 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0623 - val_loss: 0.0598 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0615 - val_loss: 0.0595 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0611 - val_loss: 0.0593 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0625 - val_loss: 0.0594 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0621 - val_loss: 0.0595 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0621 - val_loss: 0.0595 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0620 - val_loss: 0.0595 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0627 - val_loss: 0.0595 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0631 - val_loss: 0.0596 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0616 - val_loss: 0.0596 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0627 - val_loss: 0.0596 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0634 - val_loss: 0.0596 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0630 - val_loss: 0.0596 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0610 - val_loss: 0.0596 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0613 - val_loss: 0.0596 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0626 - val_loss: 0.0596 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0617 - val_loss: 0.0596 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0627 - val_loss: 0.0596 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0603 - val_loss: 0.0596 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0618 - val_loss: 0.0596 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0620 - val_loss: 0.0596 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0622 - val_loss: 0.0596 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0644 - val_loss: 0.0596 - lr: 1.6702e-08
Epoch 1/100
17/17 [==============================] - 5s 74ms/step - loss: 0.1235 - val_loss: 0.1201 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1142 - val_loss: 0.1017 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1058 - val_loss: 0.0995 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0997 - val_loss: 0.1022 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0966 - val_loss: 0.0981 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0926 - val_loss: 0.0983 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0901 - val_loss: 0.0955 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0890 - val_loss: 0.0929 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0843 - val_loss: 0.0868 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0806 - val_loss: 0.0826 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0765 - val_loss: 0.0882 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0777 - val_loss: 0.0853 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0771 - val_loss: 0.0809 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0780 - val_loss: 0.0700 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0716 - val_loss: 0.0678 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0699 - val_loss: 0.0651 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0682 - val_loss: 0.0634 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0677 - val_loss: 0.0632 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0668 - val_loss: 0.0600 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0650 - val_loss: 0.0610 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0655 - val_loss: 0.0570 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0623 - val_loss: 0.0564 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0624 - val_loss: 0.0556 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0623 - val_loss: 0.0552 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0608 - val_loss: 0.0546 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0608 - val_loss: 0.0543 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0610 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0605 - val_loss: 0.0539 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0616 - val_loss: 0.0534 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0586 - val_loss: 0.0532 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0593 - val_loss: 0.0532 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0587 - val_loss: 0.0531 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0601 - val_loss: 0.0531 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0592 - val_loss: 0.0530 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0598 - val_loss: 0.0529 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0618 - val_loss: 0.0529 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0607 - val_loss: 0.0529 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0603 - val_loss: 0.0529 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0593 - val_loss: 0.0529 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0601 - val_loss: 0.0528 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0590 - val_loss: 0.0528 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0607 - val_loss: 0.0528 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0603 - val_loss: 0.0528 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0585 - val_loss: 0.0528 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0605 - val_loss: 0.0528 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0601 - val_loss: 0.0528 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0609 - val_loss: 0.0528 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0588 - val_loss: 0.0528 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0597 - val_loss: 0.0528 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0610 - val_loss: 0.0528 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0587 - val_loss: 0.0528 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0597 - val_loss: 0.0528 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 1s 49ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 44ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0604 - val_loss: 0.0528 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0587 - val_loss: 0.0528 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0606 - val_loss: 0.0528 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0609 - val_loss: 0.0528 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0605 - val_loss: 0.0528 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0590 - val_loss: 0.0528 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0599 - val_loss: 0.0528 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 1s 44ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 4.6110e-14
Epoch 1/100
22/22 [==============================] - 6s 96ms/step - loss: 0.1183 - val_loss: 0.1068 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1082 - val_loss: 0.1049 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1039 - val_loss: 0.1015 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0956 - val_loss: 0.0967 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0924 - val_loss: 0.0937 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0930 - val_loss: 0.0955 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0895 - val_loss: 0.0918 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0882 - val_loss: 0.0896 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0850 - val_loss: 0.0899 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0815 - val_loss: 0.0863 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0796 - val_loss: 0.0858 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0771 - val_loss: 0.0848 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0760 - val_loss: 0.0829 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0735 - val_loss: 0.0800 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0689 - val_loss: 0.0767 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0670 - val_loss: 0.0719 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0650 - val_loss: 0.0704 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0642 - val_loss: 0.0670 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0609 - val_loss: 0.0652 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0597 - val_loss: 0.0623 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0579 - val_loss: 0.0580 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0571 - val_loss: 0.0559 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0558 - val_loss: 0.0541 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0548 - val_loss: 0.0531 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0547 - val_loss: 0.0525 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0543 - val_loss: 0.0524 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0542 - val_loss: 0.0514 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0533 - val_loss: 0.0512 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0538 - val_loss: 0.0511 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0537 - val_loss: 0.0506 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 51ms/step - loss: 0.0528 - val_loss: 0.0504 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0537 - val_loss: 0.0504 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0545 - val_loss: 0.0504 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0531 - val_loss: 0.0504 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0529 - val_loss: 0.0503 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0530 - val_loss: 0.0501 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0539 - val_loss: 0.0502 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0529 - val_loss: 0.0502 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0534 - val_loss: 0.0502 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0532 - val_loss: 0.0502 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0531 - val_loss: 0.0502 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0528 - val_loss: 0.0502 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0542 - val_loss: 0.0502 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0526 - val_loss: 0.0502 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0532 - val_loss: 0.0502 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0535 - val_loss: 0.0502 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0529 - val_loss: 0.0502 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0530 - val_loss: 0.0502 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0540 - val_loss: 0.0502 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0535 - val_loss: 0.0502 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0537 - val_loss: 0.0502 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0529 - val_loss: 0.0502 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0525 - val_loss: 0.0502 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0535 - val_loss: 0.0502 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0534 - val_loss: 0.0502 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0530 - val_loss: 0.0502 - lr: 2.2603e-09
Average Validation Loss: 0.06788384094834328
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 77ms/step - loss: 0.1111 - val_loss: 0.1285 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1086 - val_loss: 0.1231 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 23ms/step - loss: 0.1094 - val_loss: 0.1130 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 24ms/step - loss: 0.1079 - val_loss: 0.1099 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0945 - val_loss: 0.1113 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0932 - val_loss: 0.1072 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0907 - val_loss: 0.1038 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0861 - val_loss: 0.1038 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0817 - val_loss: 0.0963 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0702 - val_loss: 0.0938 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0602 - val_loss: 0.1062 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0671 - val_loss: 0.0905 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0529 - val_loss: 0.0979 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0537 - val_loss: 0.0869 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 1s 32ms/step - loss: 0.0551 - val_loss: 0.0956 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0502 - val_loss: 0.0827 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0490 - val_loss: 0.0898 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0492 - val_loss: 0.0900 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0455 - val_loss: 0.0809 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0438 - val_loss: 0.0966 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0477 - val_loss: 0.0787 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0441 - val_loss: 0.0954 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0476 - val_loss: 0.0824 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0418 - val_loss: 0.0895 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0444 - val_loss: 0.0806 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0445 - val_loss: 0.0852 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0423 - val_loss: 0.0869 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0428 - val_loss: 0.0846 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0408 - val_loss: 0.0841 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0446 - val_loss: 0.0847 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0422 - val_loss: 0.0838 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0417 - val_loss: 0.0847 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0429 - val_loss: 0.0850 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0415 - val_loss: 0.0842 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0428 - val_loss: 0.0839 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0421 - val_loss: 0.0840 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0422 - val_loss: 0.0838 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0413 - val_loss: 0.0837 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 1s 80ms/step - loss: 0.0411 - val_loss: 0.0838 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 4s 227ms/step - loss: 0.0418 - val_loss: 0.0839 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 3s 151ms/step - loss: 0.0421 - val_loss: 0.0840 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 8s 77ms/step - loss: 0.1495 - val_loss: 0.0798 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1306 - val_loss: 0.0794 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1145 - val_loss: 0.0747 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1161 - val_loss: 0.0621 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1137 - val_loss: 0.0729 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1073 - val_loss: 0.0581 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1035 - val_loss: 0.0675 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1008 - val_loss: 0.0616 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1000 - val_loss: 0.0623 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0967 - val_loss: 0.0611 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0899 - val_loss: 0.0763 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0839 - val_loss: 0.0687 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0858 - val_loss: 0.0670 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0820 - val_loss: 0.0681 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0760 - val_loss: 0.0694 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0717 - val_loss: 0.0712 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0696 - val_loss: 0.0651 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0671 - val_loss: 0.0677 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0635 - val_loss: 0.0605 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0611 - val_loss: 0.0581 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0593 - val_loss: 0.0555 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0581 - val_loss: 0.0539 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0557 - val_loss: 0.0569 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0544 - val_loss: 0.0581 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0515 - val_loss: 0.0601 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0594 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0515 - val_loss: 0.0607 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0508 - val_loss: 0.0586 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0618 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0506 - val_loss: 0.0612 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0492 - val_loss: 0.0597 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0592 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0507 - val_loss: 0.0595 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0495 - val_loss: 0.0612 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0508 - val_loss: 0.0613 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0608 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0509 - val_loss: 0.0608 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0505 - val_loss: 0.0609 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0496 - val_loss: 0.0610 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0494 - val_loss: 0.0609 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0496 - val_loss: 0.0609 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0506 - val_loss: 0.0609 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 6s 45ms/step - loss: 0.1112 - val_loss: 0.1042 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1013 - val_loss: 0.0958 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0971 - val_loss: 0.0884 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0933 - val_loss: 0.0833 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0924 - val_loss: 0.0839 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0857 - val_loss: 0.0790 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0839 - val_loss: 0.0767 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0808 - val_loss: 0.0750 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0737 - val_loss: 0.0628 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0737 - val_loss: 0.0810 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0727 - val_loss: 0.0610 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0687 - val_loss: 0.0728 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0636 - val_loss: 0.0524 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0564 - val_loss: 0.0588 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0496 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0531 - val_loss: 0.0553 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0522 - val_loss: 0.0466 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0503 - val_loss: 0.0513 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0509 - val_loss: 0.0479 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0481 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0462 - val_loss: 0.0463 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0477 - val_loss: 0.0462 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0480 - val_loss: 0.0446 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0480 - val_loss: 0.0442 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0482 - val_loss: 0.0449 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0488 - val_loss: 0.0470 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0477 - val_loss: 0.0468 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0476 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0469 - val_loss: 0.0478 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0478 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0456 - val_loss: 0.0478 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0444 - val_loss: 0.0478 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0444 - val_loss: 0.0478 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0441 - val_loss: 0.0479 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0446 - val_loss: 0.0479 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0442 - val_loss: 0.0479 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0449 - val_loss: 0.0479 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0440 - val_loss: 0.0479 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0449 - val_loss: 0.0479 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0478 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0448 - val_loss: 0.0478 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0436 - val_loss: 0.0478 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0448 - val_loss: 0.0478 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0436 - val_loss: 0.0478 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 6s 24ms/step - loss: 0.1160 - val_loss: 0.1038 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1007 - val_loss: 0.0868 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0962 - val_loss: 0.0917 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0891 - val_loss: 0.0850 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0856 - val_loss: 0.0823 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0820 - val_loss: 0.0828 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0789 - val_loss: 0.0782 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0762 - val_loss: 0.0767 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0727 - val_loss: 0.0742 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0685 - val_loss: 0.0718 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0659 - val_loss: 0.0706 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0636 - val_loss: 0.0685 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0632 - val_loss: 0.0681 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0608 - val_loss: 0.0658 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0591 - val_loss: 0.0677 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0571 - val_loss: 0.0648 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0554 - val_loss: 0.0655 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0547 - val_loss: 0.0646 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0531 - val_loss: 0.0636 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0529 - val_loss: 0.0656 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0517 - val_loss: 0.0652 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0508 - val_loss: 0.0662 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0510 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0508 - val_loss: 0.0629 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0513 - val_loss: 0.0606 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0511 - val_loss: 0.0568 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0498 - val_loss: 0.0551 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0508 - val_loss: 0.0535 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0485 - val_loss: 0.0530 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0491 - val_loss: 0.0526 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0474 - val_loss: 0.0517 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0479 - val_loss: 0.0514 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0480 - val_loss: 0.0513 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0468 - val_loss: 0.0511 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0459 - val_loss: 0.0511 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0475 - val_loss: 0.0510 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0476 - val_loss: 0.0509 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0477 - val_loss: 0.0509 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0509 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0466 - val_loss: 0.0509 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0475 - val_loss: 0.0508 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0473 - val_loss: 0.0508 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0464 - val_loss: 0.0508 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0508 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0470 - val_loss: 0.0508 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0508 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0473 - val_loss: 0.0508 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0508 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0508 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0508 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0468 - val_loss: 0.0508 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0464 - val_loss: 0.0508 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0468 - val_loss: 0.0508 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0462 - val_loss: 0.0508 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0474 - val_loss: 0.0508 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0460 - val_loss: 0.0508 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0475 - val_loss: 0.0508 - lr: 2.8039e-15
Epoch 1/100
85/85 [==============================] - 5s 27ms/step - loss: 0.1178 - val_loss: 0.0955 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1039 - val_loss: 0.0903 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0988 - val_loss: 0.0869 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0942 - val_loss: 0.0863 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0890 - val_loss: 0.0859 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0856 - val_loss: 0.0839 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0842 - val_loss: 0.0826 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0820 - val_loss: 0.0814 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0721 - val_loss: 0.0773 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0701 - val_loss: 0.0756 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0638 - val_loss: 0.0713 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0607 - val_loss: 0.0660 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0582 - val_loss: 0.0634 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0562 - val_loss: 0.0628 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0608 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0543 - val_loss: 0.0610 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0534 - val_loss: 0.0588 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0519 - val_loss: 0.0585 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0501 - val_loss: 0.0592 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0505 - val_loss: 0.0583 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0494 - val_loss: 0.0567 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0468 - val_loss: 0.0564 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0457 - val_loss: 0.0551 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0449 - val_loss: 0.0540 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0445 - val_loss: 0.0532 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0439 - val_loss: 0.0529 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0431 - val_loss: 0.0531 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0424 - val_loss: 0.0524 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0425 - val_loss: 0.0521 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0425 - val_loss: 0.0522 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0423 - val_loss: 0.0521 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0428 - val_loss: 0.0518 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0417 - val_loss: 0.0517 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0421 - val_loss: 0.0518 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0417 - val_loss: 0.0517 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0424 - val_loss: 0.0516 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0433 - val_loss: 0.0516 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0415 - val_loss: 0.0516 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0417 - val_loss: 0.0516 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0419 - val_loss: 0.0516 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0425 - val_loss: 0.0516 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0419 - val_loss: 0.0516 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0419 - val_loss: 0.0516 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0416 - val_loss: 0.0516 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0420 - val_loss: 0.0516 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0431 - val_loss: 0.0516 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0412 - val_loss: 0.0516 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0416 - val_loss: 0.0516 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0416 - val_loss: 0.0516 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0413 - val_loss: 0.0516 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0409 - val_loss: 0.0516 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0420 - val_loss: 0.0516 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0415 - val_loss: 0.0516 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0421 - val_loss: 0.0516 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0420 - val_loss: 0.0516 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0409 - val_loss: 0.0516 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0423 - val_loss: 0.0516 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0417 - val_loss: 0.0516 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0412 - val_loss: 0.0516 - lr: 5.0565e-11
Average Validation Loss: 0.055843637138605115
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 132ms/step - loss: 0.1164 - val_loss: 0.1282 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 22ms/step - loss: 0.1030 - val_loss: 0.1290 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 20ms/step - loss: 0.1008 - val_loss: 0.1270 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 21ms/step - loss: 0.1001 - val_loss: 0.1212 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0930 - val_loss: 0.1181 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0858 - val_loss: 0.1159 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0794 - val_loss: 0.1114 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0684 - val_loss: 0.1168 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0661 - val_loss: 0.1054 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0565 - val_loss: 0.1125 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0550 - val_loss: 0.1012 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0504 - val_loss: 0.1093 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0525 - val_loss: 0.1025 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0470 - val_loss: 0.1078 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0474 - val_loss: 0.1014 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0453 - val_loss: 0.1042 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0475 - val_loss: 0.0992 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0456 - val_loss: 0.1016 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0463 - val_loss: 0.0965 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0445 - val_loss: 0.1056 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0470 - val_loss: 0.0948 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0446 - val_loss: 0.0992 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0446 - val_loss: 0.1002 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0456 - val_loss: 0.0974 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0435 - val_loss: 0.0974 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0435 - val_loss: 0.0970 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0427 - val_loss: 0.0978 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0443 - val_loss: 0.0987 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0441 - val_loss: 0.0983 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0430 - val_loss: 0.0973 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0437 - val_loss: 0.0964 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0418 - val_loss: 0.0958 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0428 - val_loss: 0.0958 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0419 - val_loss: 0.0957 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0440 - val_loss: 0.0958 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0430 - val_loss: 0.0959 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0452 - val_loss: 0.0960 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0445 - val_loss: 0.0961 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0415 - val_loss: 0.0960 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0429 - val_loss: 0.0960 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0449 - val_loss: 0.0960 - lr: 1.6616e-06
Epoch 1/100
17/17 [==============================] - 4s 56ms/step - loss: 0.1437 - val_loss: 0.0807 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 13ms/step - loss: 0.1216 - val_loss: 0.0797 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 14ms/step - loss: 0.1161 - val_loss: 0.0755 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1118 - val_loss: 0.0684 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1087 - val_loss: 0.0661 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1028 - val_loss: 0.0638 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1008 - val_loss: 0.0604 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0944 - val_loss: 0.0748 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0879 - val_loss: 0.0748 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0889 - val_loss: 0.0628 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0843 - val_loss: 0.0712 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0729 - val_loss: 0.0777 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0691 - val_loss: 0.0726 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0686 - val_loss: 0.0748 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0658 - val_loss: 0.0801 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0650 - val_loss: 0.0739 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0626 - val_loss: 0.0715 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0636 - val_loss: 0.0751 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0599 - val_loss: 0.0745 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0609 - val_loss: 0.0762 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0592 - val_loss: 0.0716 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0613 - val_loss: 0.0747 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0578 - val_loss: 0.0732 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0581 - val_loss: 0.0759 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0591 - val_loss: 0.0747 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0567 - val_loss: 0.0758 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0591 - val_loss: 0.0730 - lr: 9.0718e-05
Epoch 1/100
26/26 [==============================] - 4s 45ms/step - loss: 0.1129 - val_loss: 0.1128 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 15ms/step - loss: 0.1008 - val_loss: 0.1039 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 15ms/step - loss: 0.0960 - val_loss: 0.0948 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0915 - val_loss: 0.0890 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0870 - val_loss: 0.0837 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0868 - val_loss: 0.0768 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0822 - val_loss: 0.0730 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0792 - val_loss: 0.0697 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0784 - val_loss: 0.0648 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0733 - val_loss: 0.0635 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0687 - val_loss: 0.0603 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0654 - val_loss: 0.0611 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0644 - val_loss: 0.0586 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0637 - val_loss: 0.0574 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0648 - val_loss: 0.0579 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0626 - val_loss: 0.0574 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0619 - val_loss: 0.0587 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0596 - val_loss: 0.0584 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0567 - val_loss: 0.0587 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0550 - val_loss: 0.0567 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0559 - val_loss: 0.0557 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0545 - val_loss: 0.0554 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0530 - val_loss: 0.0559 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0537 - val_loss: 0.0552 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0527 - val_loss: 0.0544 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0524 - val_loss: 0.0538 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0518 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0514 - val_loss: 0.0537 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0519 - val_loss: 0.0540 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0523 - val_loss: 0.0539 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0522 - val_loss: 0.0534 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0525 - val_loss: 0.0535 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0518 - val_loss: 0.0536 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0516 - val_loss: 0.0535 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0522 - val_loss: 0.0535 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0522 - val_loss: 0.0534 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0517 - val_loss: 0.0533 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0516 - val_loss: 0.0533 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0514 - val_loss: 0.0533 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0529 - val_loss: 0.0533 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0508 - val_loss: 0.0533 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0526 - val_loss: 0.0533 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0510 - val_loss: 0.0533 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 15ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0527 - val_loss: 0.0533 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0505 - val_loss: 0.0533 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0512 - val_loss: 0.0533 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0523 - val_loss: 0.0533 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0523 - val_loss: 0.0533 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0516 - val_loss: 0.0533 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0530 - val_loss: 0.0533 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0513 - val_loss: 0.0533 - lr: 5.0435e-10
Epoch 60/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0511 - val_loss: 0.0533 - lr: 3.0590e-10
Epoch 61/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0525 - val_loss: 0.0533 - lr: 1.6788e-10
Epoch 62/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0513 - val_loss: 0.0533 - lr: 9.2136e-11
Epoch 63/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0507 - val_loss: 0.0533 - lr: 5.0565e-11
Epoch 64/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0508 - val_loss: 0.0533 - lr: 2.7751e-11
Epoch 1/100
34/34 [==============================] - 4s 41ms/step - loss: 0.1233 - val_loss: 0.1055 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1028 - val_loss: 0.1111 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0973 - val_loss: 0.1179 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0937 - val_loss: 0.1183 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0903 - val_loss: 0.1231 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0859 - val_loss: 0.1120 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0825 - val_loss: 0.1032 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0756 - val_loss: 0.0978 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0718 - val_loss: 0.0918 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0697 - val_loss: 0.0907 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0684 - val_loss: 0.0992 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0679 - val_loss: 0.0974 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0675 - val_loss: 0.1098 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0704 - val_loss: 0.1152 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.1200 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0835 - val_loss: 0.0991 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0797 - val_loss: 0.0886 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0742 - val_loss: 0.0900 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0742 - val_loss: 0.0881 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0728 - val_loss: 0.0839 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0679 - val_loss: 0.0790 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0660 - val_loss: 0.0759 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0652 - val_loss: 0.0738 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0642 - val_loss: 0.0718 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0611 - val_loss: 0.0721 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0617 - val_loss: 0.0711 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0702 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0604 - val_loss: 0.0702 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0600 - val_loss: 0.0699 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0600 - val_loss: 0.0697 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0599 - val_loss: 0.0697 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0584 - val_loss: 0.0697 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0593 - val_loss: 0.0693 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0595 - val_loss: 0.0693 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0593 - val_loss: 0.0692 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0602 - val_loss: 0.0691 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0593 - val_loss: 0.0691 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0592 - val_loss: 0.0691 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0594 - val_loss: 0.0691 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0594 - val_loss: 0.0691 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0597 - val_loss: 0.0691 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0605 - val_loss: 0.0690 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0596 - val_loss: 0.0691 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0602 - val_loss: 0.0690 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0601 - val_loss: 0.0690 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0603 - val_loss: 0.0690 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0595 - val_loss: 0.0690 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0595 - val_loss: 0.0690 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0594 - val_loss: 0.0690 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0597 - val_loss: 0.0690 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0588 - val_loss: 0.0690 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0598 - val_loss: 0.0690 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0586 - val_loss: 0.0690 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0584 - val_loss: 0.0690 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0600 - val_loss: 0.0690 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0587 - val_loss: 0.0690 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0590 - val_loss: 0.0690 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0597 - val_loss: 0.0690 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0594 - val_loss: 0.0690 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0599 - val_loss: 0.0690 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0594 - val_loss: 0.0690 - lr: 1.1370e-14
Epoch 77/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0596 - val_loss: 0.0690 - lr: 5.6464e-15
Epoch 1/100
43/43 [==============================] - 6s 35ms/step - loss: 0.1147 - val_loss: 0.0969 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1032 - val_loss: 0.0918 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0919 - val_loss: 0.0872 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0840 - val_loss: 0.0837 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0783 - val_loss: 0.0812 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0729 - val_loss: 0.0768 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0640 - val_loss: 0.0725 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0686 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0616 - val_loss: 0.0656 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0565 - val_loss: 0.0669 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0570 - val_loss: 0.0641 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0555 - val_loss: 0.0613 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0534 - val_loss: 0.0572 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0503 - val_loss: 0.0590 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0501 - val_loss: 0.0562 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0480 - val_loss: 0.0544 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0478 - val_loss: 0.0538 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0469 - val_loss: 0.0500 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0452 - val_loss: 0.0482 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0444 - val_loss: 0.0479 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0448 - val_loss: 0.0483 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0446 - val_loss: 0.0482 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0426 - val_loss: 0.0477 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0431 - val_loss: 0.0465 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0415 - val_loss: 0.0460 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0416 - val_loss: 0.0455 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0422 - val_loss: 0.0447 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0409 - val_loss: 0.0444 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0402 - val_loss: 0.0440 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0407 - val_loss: 0.0438 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0413 - val_loss: 0.0437 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0406 - val_loss: 0.0438 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0403 - val_loss: 0.0436 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0406 - val_loss: 0.0435 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0405 - val_loss: 0.0436 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0405 - val_loss: 0.0436 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0400 - val_loss: 0.0435 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0435 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0401 - val_loss: 0.0435 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0408 - val_loss: 0.0435 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0410 - val_loss: 0.0435 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0409 - val_loss: 0.0435 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0402 - val_loss: 0.0435 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0397 - val_loss: 0.0435 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0435 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0402 - val_loss: 0.0435 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0412 - val_loss: 0.0435 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0404 - val_loss: 0.0435 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0409 - val_loss: 0.0435 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0400 - val_loss: 0.0435 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0407 - val_loss: 0.0435 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0404 - val_loss: 0.0435 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0401 - val_loss: 0.0435 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0435 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0401 - val_loss: 0.0435 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0405 - val_loss: 0.0435 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0409 - val_loss: 0.0435 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0397 - val_loss: 0.0435 - lr: 8.3153e-10
Average Validation Loss: 0.06419765502214432
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 7s 394ms/step - loss: 0.1266 - val_loss: 0.1103 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 54ms/step - loss: 0.0915 - val_loss: 0.1213 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0946 - val_loss: 0.1298 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1048 - val_loss: 0.1295 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1009 - val_loss: 0.1234 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0960 - val_loss: 0.1127 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0895 - val_loss: 0.1009 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0822 - val_loss: 0.0961 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0747 - val_loss: 0.1009 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 53ms/step - loss: 0.0712 - val_loss: 0.1068 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0722 - val_loss: 0.1024 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0632 - val_loss: 0.0977 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0632 - val_loss: 0.0998 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0593 - val_loss: 0.1037 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0587 - val_loss: 0.1000 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0564 - val_loss: 0.1046 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0556 - val_loss: 0.1056 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0539 - val_loss: 0.1057 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0516 - val_loss: 0.1071 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0535 - val_loss: 0.1048 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0522 - val_loss: 0.1018 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0499 - val_loss: 0.1019 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0497 - val_loss: 0.1047 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0508 - val_loss: 0.1053 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0531 - val_loss: 0.1044 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0488 - val_loss: 0.1042 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0538 - val_loss: 0.1049 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0504 - val_loss: 0.1059 - lr: 7.4274e-05
Epoch 1/100
9/9 [==============================] - 5s 142ms/step - loss: 0.1379 - val_loss: 0.1003 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1208 - val_loss: 0.0854 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1133 - val_loss: 0.0818 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1047 - val_loss: 0.0750 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1012 - val_loss: 0.0656 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0969 - val_loss: 0.0754 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0952 - val_loss: 0.0666 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0895 - val_loss: 0.0736 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0846 - val_loss: 0.0692 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0806 - val_loss: 0.0773 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0762 - val_loss: 0.0803 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0740 - val_loss: 0.0809 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0720 - val_loss: 0.0769 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0700 - val_loss: 0.0732 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0684 - val_loss: 0.0806 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0677 - val_loss: 0.0789 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0664 - val_loss: 0.0758 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0657 - val_loss: 0.0723 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0641 - val_loss: 0.0859 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0635 - val_loss: 0.0737 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0615 - val_loss: 0.0777 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0652 - val_loss: 0.0802 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0633 - val_loss: 0.0775 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0630 - val_loss: 0.0729 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0601 - val_loss: 0.0769 - lr: 1.3534e-04
Epoch 1/100
13/13 [==============================] - 6s 100ms/step - loss: 0.2172 - val_loss: 0.1609 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1114 - val_loss: 0.1146 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1081 - val_loss: 0.1121 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1022 - val_loss: 0.1132 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0934 - val_loss: 0.1033 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0891 - val_loss: 0.0945 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0869 - val_loss: 0.0876 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0854 - val_loss: 0.0810 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0812 - val_loss: 0.0773 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0771 - val_loss: 0.0711 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0746 - val_loss: 0.0686 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0713 - val_loss: 0.0667 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 22ms/step - loss: 0.0694 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 23ms/step - loss: 0.0703 - val_loss: 0.0634 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0704 - val_loss: 0.0620 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 23ms/step - loss: 0.0667 - val_loss: 0.0609 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0672 - val_loss: 0.0610 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0628 - val_loss: 0.0598 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0629 - val_loss: 0.0581 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0624 - val_loss: 0.0572 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 23ms/step - loss: 0.0616 - val_loss: 0.0563 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0605 - val_loss: 0.0559 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 1s 35ms/step - loss: 0.0606 - val_loss: 0.0552 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0589 - val_loss: 0.0548 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0615 - val_loss: 0.0548 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0604 - val_loss: 0.0545 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0575 - val_loss: 0.0543 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 1s 47ms/step - loss: 0.0571 - val_loss: 0.0542 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0586 - val_loss: 0.0539 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0578 - val_loss: 0.0539 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0589 - val_loss: 0.0538 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 1s 48ms/step - loss: 0.0570 - val_loss: 0.0537 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0575 - val_loss: 0.0536 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0574 - val_loss: 0.0536 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0586 - val_loss: 0.0536 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0586 - val_loss: 0.0536 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 1s 45ms/step - loss: 0.0571 - val_loss: 0.0536 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 1s 60ms/step - loss: 0.0576 - val_loss: 0.0536 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 1s 55ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 1s 45ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0567 - val_loss: 0.0535 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 1s 53ms/step - loss: 0.0570 - val_loss: 0.0535 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0578 - val_loss: 0.0535 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 1s 71ms/step - loss: 0.0573 - val_loss: 0.0535 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 1s 56ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 45ms/step - loss: 0.0586 - val_loss: 0.0535 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0580 - val_loss: 0.0535 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0576 - val_loss: 0.0535 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 1s 55ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 1s 81ms/step - loss: 0.0563 - val_loss: 0.0535 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 1s 63ms/step - loss: 0.0573 - val_loss: 0.0535 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 1s 57ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 1s 66ms/step - loss: 0.0561 - val_loss: 0.0535 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0581 - val_loss: 0.0535 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0587 - val_loss: 0.0535 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0575 - val_loss: 0.0535 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0580 - val_loss: 0.0535 - lr: 5.0565e-11
Epoch 64/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0585 - val_loss: 0.0535 - lr: 2.7751e-11
Epoch 65/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 1.5230e-11
Epoch 66/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0584 - val_loss: 0.0535 - lr: 8.3584e-12
Epoch 67/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0575 - val_loss: 0.0535 - lr: 4.5872e-12
Epoch 68/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 2.5175e-12
Epoch 69/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 1.3816e-12
Epoch 70/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 7.5826e-13
Epoch 71/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0587 - val_loss: 0.0535 - lr: 3.7654e-13
Epoch 72/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 1.8698e-13
Epoch 73/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0577 - val_loss: 0.0535 - lr: 9.2853e-14
Epoch 74/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0584 - val_loss: 0.0535 - lr: 4.6110e-14
Epoch 75/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0565 - val_loss: 0.0535 - lr: 2.2897e-14
Epoch 1/100
17/17 [==============================] - 5s 114ms/step - loss: 0.1193 - val_loss: 0.1025 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 36ms/step - loss: 0.1053 - val_loss: 0.0897 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0938 - val_loss: 0.0875 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 47ms/step - loss: 0.0899 - val_loss: 0.0850 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 29ms/step - loss: 0.0851 - val_loss: 0.0883 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0830 - val_loss: 0.0834 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0795 - val_loss: 0.0756 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0758 - val_loss: 0.0775 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0747 - val_loss: 0.0801 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0731 - val_loss: 0.0807 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0739 - val_loss: 0.0771 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0736 - val_loss: 0.0642 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0661 - val_loss: 0.0652 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0645 - val_loss: 0.0696 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0662 - val_loss: 0.0638 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0651 - val_loss: 0.0559 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0596 - val_loss: 0.0541 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0584 - val_loss: 0.0527 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0571 - val_loss: 0.0561 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0585 - val_loss: 0.0552 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0590 - val_loss: 0.0480 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0557 - val_loss: 0.0465 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0548 - val_loss: 0.0466 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0548 - val_loss: 0.0464 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0551 - val_loss: 0.0452 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 84ms/step - loss: 0.0533 - val_loss: 0.0451 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0533 - val_loss: 0.0450 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0527 - val_loss: 0.0444 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0520 - val_loss: 0.0441 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0526 - val_loss: 0.0442 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0525 - val_loss: 0.0439 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0530 - val_loss: 0.0440 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0528 - val_loss: 0.0439 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0528 - val_loss: 0.0440 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0525 - val_loss: 0.0439 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0509 - val_loss: 0.0439 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0512 - val_loss: 0.0439 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0520 - val_loss: 0.0439 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0525 - val_loss: 0.0438 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0531 - val_loss: 0.0438 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0529 - val_loss: 0.0438 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0520 - val_loss: 0.0438 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0515 - val_loss: 0.0438 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0527 - val_loss: 0.0438 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0510 - val_loss: 0.0438 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0519 - val_loss: 0.0438 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0522 - val_loss: 0.0438 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0522 - val_loss: 0.0438 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0515 - val_loss: 0.0438 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0516 - val_loss: 0.0438 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0521 - val_loss: 0.0438 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0534 - val_loss: 0.0438 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0529 - val_loss: 0.0438 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0527 - val_loss: 0.0438 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0534 - val_loss: 0.0438 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0531 - val_loss: 0.0438 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0521 - val_loss: 0.0438 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0518 - val_loss: 0.0438 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0530 - val_loss: 0.0438 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0518 - val_loss: 0.0438 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0533 - val_loss: 0.0438 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0530 - val_loss: 0.0438 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 1.1370e-14
Epoch 1/100
22/22 [==============================] - 5s 66ms/step - loss: 0.1499 - val_loss: 0.1015 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 20ms/step - loss: 0.1092 - val_loss: 0.1019 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 20ms/step - loss: 0.1020 - val_loss: 0.1034 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0994 - val_loss: 0.1030 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0979 - val_loss: 0.1033 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0947 - val_loss: 0.1019 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0939 - val_loss: 0.1033 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0919 - val_loss: 0.1023 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0902 - val_loss: 0.1004 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0876 - val_loss: 0.1007 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0864 - val_loss: 0.1013 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0858 - val_loss: 0.0993 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0814 - val_loss: 0.0985 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0813 - val_loss: 0.0976 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0774 - val_loss: 0.0965 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0759 - val_loss: 0.0958 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0745 - val_loss: 0.0955 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0746 - val_loss: 0.0951 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0731 - val_loss: 0.0939 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0713 - val_loss: 0.0926 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0688 - val_loss: 0.0927 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 20ms/step - loss: 0.0690 - val_loss: 0.0914 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 20ms/step - loss: 0.0683 - val_loss: 0.0908 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0682 - val_loss: 0.0906 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0667 - val_loss: 0.0902 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0651 - val_loss: 0.0898 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0650 - val_loss: 0.0892 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0643 - val_loss: 0.0889 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0657 - val_loss: 0.0887 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0650 - val_loss: 0.0888 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0648 - val_loss: 0.0885 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0636 - val_loss: 0.0885 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0645 - val_loss: 0.0884 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0638 - val_loss: 0.0883 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 20ms/step - loss: 0.0635 - val_loss: 0.0883 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0655 - val_loss: 0.0883 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0642 - val_loss: 0.0882 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0640 - val_loss: 0.0882 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0633 - val_loss: 0.0882 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0629 - val_loss: 0.0882 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0640 - val_loss: 0.0882 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0645 - val_loss: 0.0882 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0646 - val_loss: 0.0882 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0635 - val_loss: 0.0882 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0645 - val_loss: 0.0882 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0629 - val_loss: 0.0882 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0644 - val_loss: 0.0882 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0645 - val_loss: 0.0882 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0634 - val_loss: 0.0882 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0637 - val_loss: 0.0882 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0635 - val_loss: 0.0882 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0637 - val_loss: 0.0882 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0654 - val_loss: 0.0882 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0647 - val_loss: 0.0882 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0644 - val_loss: 0.0882 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0637 - val_loss: 0.0882 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0640 - val_loss: 0.0882 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0642 - val_loss: 0.0882 - lr: 5.6464e-15
Average Validation Loss: 0.06944532468914985
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 153ms/step - loss: 0.2246 - val_loss: 0.2810 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.2371 - val_loss: 0.2229 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1971 - val_loss: 0.2211 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1940 - val_loss: 0.2021 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1659 - val_loss: 0.2213 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1721 - val_loss: 0.1989 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1534 - val_loss: 0.1826 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1280 - val_loss: 0.1979 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1220 - val_loss: 0.1795 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1140 - val_loss: 0.1726 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1060 - val_loss: 0.1670 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1037 - val_loss: 0.1584 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1009 - val_loss: 0.1370 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1043 - val_loss: 0.1435 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0908 - val_loss: 0.1523 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0940 - val_loss: 0.1648 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0933 - val_loss: 0.1670 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0967 - val_loss: 0.1455 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0886 - val_loss: 0.1317 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0895 - val_loss: 0.1375 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 1s 38ms/step - loss: 0.0862 - val_loss: 0.1536 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0868 - val_loss: 0.1341 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0808 - val_loss: 0.1438 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0834 - val_loss: 0.1358 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0812 - val_loss: 0.1406 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0813 - val_loss: 0.1365 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0801 - val_loss: 0.1358 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0793 - val_loss: 0.1337 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0804 - val_loss: 0.1347 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0800 - val_loss: 0.1401 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0804 - val_loss: 0.1391 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 43ms/step - loss: 0.0808 - val_loss: 0.1371 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 1s 41ms/step - loss: 0.0794 - val_loss: 0.1349 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 1s 34ms/step - loss: 0.0798 - val_loss: 0.1348 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 1s 32ms/step - loss: 0.0794 - val_loss: 0.1350 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0799 - val_loss: 0.1356 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0779 - val_loss: 0.1360 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0794 - val_loss: 0.1362 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0793 - val_loss: 0.1363 - lr: 3.3460e-06
Epoch 1/100
34/34 [==============================] - 6s 47ms/step - loss: 0.2527 - val_loss: 0.1762 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 25ms/step - loss: 0.2238 - val_loss: 0.1583 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1994 - val_loss: 0.1480 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1842 - val_loss: 0.1355 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1715 - val_loss: 0.1212 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1598 - val_loss: 0.1269 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1537 - val_loss: 0.1109 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1466 - val_loss: 0.1171 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1405 - val_loss: 0.1076 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1397 - val_loss: 0.1185 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1274 - val_loss: 0.1062 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1242 - val_loss: 0.1061 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1171 - val_loss: 0.1107 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1120 - val_loss: 0.1079 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1052 - val_loss: 0.1056 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1009 - val_loss: 0.1013 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0971 - val_loss: 0.0970 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0930 - val_loss: 0.0929 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0894 - val_loss: 0.0871 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0852 - val_loss: 0.0837 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0781 - val_loss: 0.0806 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0750 - val_loss: 0.0797 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0743 - val_loss: 0.0786 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0715 - val_loss: 0.0819 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0702 - val_loss: 0.0806 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0705 - val_loss: 0.0833 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0677 - val_loss: 0.0824 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0691 - val_loss: 0.0822 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0680 - val_loss: 0.0811 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0681 - val_loss: 0.0818 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0683 - val_loss: 0.0821 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0665 - val_loss: 0.0826 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0672 - val_loss: 0.0825 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0661 - val_loss: 0.0829 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0671 - val_loss: 0.0828 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0665 - val_loss: 0.0826 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0675 - val_loss: 0.0825 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0662 - val_loss: 0.0824 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0662 - val_loss: 0.0824 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0660 - val_loss: 0.0825 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 5s 33ms/step - loss: 0.2315 - val_loss: 0.2060 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1967 - val_loss: 0.1789 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1728 - val_loss: 0.1575 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1576 - val_loss: 0.1430 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 22ms/step - loss: 0.1452 - val_loss: 0.1346 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1370 - val_loss: 0.1293 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 2s 33ms/step - loss: 0.1258 - val_loss: 0.1163 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1258 - val_loss: 0.1225 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 26ms/step - loss: 0.1208 - val_loss: 0.1107 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1085 - val_loss: 0.1081 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 2s 32ms/step - loss: 0.1038 - val_loss: 0.0937 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0996 - val_loss: 0.1027 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0934 - val_loss: 0.0818 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 2s 33ms/step - loss: 0.0864 - val_loss: 0.0896 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0835 - val_loss: 0.0791 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0794 - val_loss: 0.0792 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0758 - val_loss: 0.0739 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0733 - val_loss: 0.0724 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0721 - val_loss: 0.0724 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0700 - val_loss: 0.0711 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0690 - val_loss: 0.0697 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0658 - val_loss: 0.0701 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0665 - val_loss: 0.0685 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0664 - val_loss: 0.0662 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0661 - val_loss: 0.0639 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0637 - val_loss: 0.0632 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0639 - val_loss: 0.0630 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0625 - val_loss: 0.0627 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0618 - val_loss: 0.0628 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0603 - val_loss: 0.0623 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0604 - val_loss: 0.0626 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0588 - val_loss: 0.0626 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0587 - val_loss: 0.0625 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0587 - val_loss: 0.0626 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0595 - val_loss: 0.0626 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0589 - val_loss: 0.0624 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0583 - val_loss: 0.0624 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0581 - val_loss: 0.0623 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0578 - val_loss: 0.0624 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0574 - val_loss: 0.0624 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0588 - val_loss: 0.0624 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0582 - val_loss: 0.0624 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0580 - val_loss: 0.0624 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0587 - val_loss: 0.0625 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0585 - val_loss: 0.0624 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0582 - val_loss: 0.0624 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0574 - val_loss: 0.0624 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0584 - val_loss: 0.0624 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0575 - val_loss: 0.0624 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0588 - val_loss: 0.0624 - lr: 4.5400e-08
Epoch 1/100
68/68 [==============================] - 6s 42ms/step - loss: 0.2206 - val_loss: 0.2245 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1876 - val_loss: 0.1753 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1610 - val_loss: 0.1498 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1442 - val_loss: 0.1392 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1347 - val_loss: 0.1345 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1287 - val_loss: 0.1338 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 2s 23ms/step - loss: 0.1166 - val_loss: 0.1264 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1100 - val_loss: 0.1168 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1033 - val_loss: 0.1163 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0996 - val_loss: 0.1073 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0907 - val_loss: 0.1008 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0855 - val_loss: 0.0925 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0822 - val_loss: 0.0872 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0781 - val_loss: 0.0865 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0758 - val_loss: 0.0824 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0736 - val_loss: 0.0815 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0723 - val_loss: 0.0796 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0690 - val_loss: 0.0776 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0682 - val_loss: 0.0779 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0678 - val_loss: 0.0772 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0647 - val_loss: 0.0770 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0743 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0609 - val_loss: 0.0731 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0619 - val_loss: 0.0703 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0601 - val_loss: 0.0691 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0598 - val_loss: 0.0673 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0601 - val_loss: 0.0664 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0609 - val_loss: 0.0626 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0597 - val_loss: 0.0604 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0587 - val_loss: 0.0596 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0575 - val_loss: 0.0585 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0575 - val_loss: 0.0577 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0572 - val_loss: 0.0573 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0567 - val_loss: 0.0570 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0567 - val_loss: 0.0568 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0564 - val_loss: 0.0567 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 2s 36ms/step - loss: 0.0559 - val_loss: 0.0566 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 3s 38ms/step - loss: 0.0565 - val_loss: 0.0566 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0564 - val_loss: 0.0566 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0554 - val_loss: 0.0565 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0559 - val_loss: 0.0565 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0563 - val_loss: 0.0565 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0564 - val_loss: 0.0565 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0552 - val_loss: 0.0565 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0559 - val_loss: 0.0565 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0560 - val_loss: 0.0565 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0555 - val_loss: 0.0565 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0555 - val_loss: 0.0565 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0554 - val_loss: 0.0565 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0556 - val_loss: 0.0565 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0564 - val_loss: 0.0565 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0566 - val_loss: 0.0565 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0553 - val_loss: 0.0565 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0565 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0559 - val_loss: 0.0565 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0554 - val_loss: 0.0565 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0566 - val_loss: 0.0565 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0562 - val_loss: 0.0565 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0564 - val_loss: 0.0565 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0556 - val_loss: 0.0565 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0556 - val_loss: 0.0565 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0563 - val_loss: 0.0565 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0562 - val_loss: 0.0565 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 7s 25ms/step - loss: 0.2231 - val_loss: 0.1888 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1754 - val_loss: 0.1594 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1499 - val_loss: 0.1458 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 21ms/step - loss: 0.1324 - val_loss: 0.1353 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1233 - val_loss: 0.1286 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1153 - val_loss: 0.1239 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1037 - val_loss: 0.1168 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0977 - val_loss: 0.1125 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0925 - val_loss: 0.1085 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0869 - val_loss: 0.1040 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0822 - val_loss: 0.1001 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0743 - val_loss: 0.0968 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0719 - val_loss: 0.0946 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0706 - val_loss: 0.0948 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0708 - val_loss: 0.0927 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0677 - val_loss: 0.0910 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0652 - val_loss: 0.0904 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0645 - val_loss: 0.0890 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0618 - val_loss: 0.0878 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0869 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0605 - val_loss: 0.0847 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0590 - val_loss: 0.0835 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0567 - val_loss: 0.0829 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0551 - val_loss: 0.0825 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0533 - val_loss: 0.0816 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0526 - val_loss: 0.0818 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0521 - val_loss: 0.0812 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0524 - val_loss: 0.0810 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 29ms/step - loss: 0.0518 - val_loss: 0.0806 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0515 - val_loss: 0.0802 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0510 - val_loss: 0.0800 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0507 - val_loss: 0.0794 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0504 - val_loss: 0.0791 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0505 - val_loss: 0.0787 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0497 - val_loss: 0.0786 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0499 - val_loss: 0.0785 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0499 - val_loss: 0.0785 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0500 - val_loss: 0.0784 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0497 - val_loss: 0.0784 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0784 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0501 - val_loss: 0.0784 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0491 - val_loss: 0.0783 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0783 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0494 - val_loss: 0.0783 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0501 - val_loss: 0.0783 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0489 - val_loss: 0.0783 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0500 - val_loss: 0.0783 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0500 - val_loss: 0.0783 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0500 - val_loss: 0.0783 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 6.9144e-16
Average Validation Loss: 0.08145372942090034
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 5s 152ms/step - loss: 0.2329 - val_loss: 0.2725 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.2411 - val_loss: 0.2514 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 24ms/step - loss: 0.2248 - val_loss: 0.2227 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1990 - val_loss: 0.2181 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1899 - val_loss: 0.2128 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1821 - val_loss: 0.1960 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1628 - val_loss: 0.1888 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1445 - val_loss: 0.1759 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1435 - val_loss: 0.1788 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1468 - val_loss: 0.1966 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1569 - val_loss: 0.1556 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1189 - val_loss: 0.1814 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1308 - val_loss: 0.1445 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1182 - val_loss: 0.1731 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1153 - val_loss: 0.1406 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1082 - val_loss: 0.1629 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1102 - val_loss: 0.1398 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1037 - val_loss: 0.1516 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1031 - val_loss: 0.1382 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1012 - val_loss: 0.1481 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1011 - val_loss: 0.1401 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0985 - val_loss: 0.1401 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0973 - val_loss: 0.1406 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0979 - val_loss: 0.1382 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0967 - val_loss: 0.1390 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0974 - val_loss: 0.1386 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0961 - val_loss: 0.1379 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0949 - val_loss: 0.1366 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0946 - val_loss: 0.1358 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0951 - val_loss: 0.1363 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0945 - val_loss: 0.1371 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0940 - val_loss: 0.1370 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0945 - val_loss: 0.1366 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0939 - val_loss: 0.1364 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0944 - val_loss: 0.1364 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0935 - val_loss: 0.1364 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0943 - val_loss: 0.1365 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0946 - val_loss: 0.1365 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0944 - val_loss: 0.1365 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0958 - val_loss: 0.1365 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0949 - val_loss: 0.1365 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0955 - val_loss: 0.1365 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0949 - val_loss: 0.1365 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0943 - val_loss: 0.1365 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0952 - val_loss: 0.1365 - lr: 6.7729e-08
Epoch 1/100
17/17 [==============================] - 3s 60ms/step - loss: 0.2624 - val_loss: 0.2009 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 15ms/step - loss: 0.2318 - val_loss: 0.1895 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 15ms/step - loss: 0.2139 - val_loss: 0.1660 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1985 - val_loss: 0.1590 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1869 - val_loss: 0.1471 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1775 - val_loss: 0.1417 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1632 - val_loss: 0.1403 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1544 - val_loss: 0.1321 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1460 - val_loss: 0.1213 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1343 - val_loss: 0.1219 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1252 - val_loss: 0.1276 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1218 - val_loss: 0.1163 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1166 - val_loss: 0.1053 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1102 - val_loss: 0.1006 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1055 - val_loss: 0.1003 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1001 - val_loss: 0.1046 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0946 - val_loss: 0.1094 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0918 - val_loss: 0.1061 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0904 - val_loss: 0.1046 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0899 - val_loss: 0.0993 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0880 - val_loss: 0.0945 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0877 - val_loss: 0.0972 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0852 - val_loss: 0.0972 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0843 - val_loss: 0.0955 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0838 - val_loss: 0.0986 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0829 - val_loss: 0.0963 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0830 - val_loss: 0.0956 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0819 - val_loss: 0.0967 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0821 - val_loss: 0.0949 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0821 - val_loss: 0.0958 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0816 - val_loss: 0.0951 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0802 - val_loss: 0.0954 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0814 - val_loss: 0.0956 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0824 - val_loss: 0.0961 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0814 - val_loss: 0.0962 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0816 - val_loss: 0.0956 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0826 - val_loss: 0.0955 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0810 - val_loss: 0.0954 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0804 - val_loss: 0.0955 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0816 - val_loss: 0.0955 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0810 - val_loss: 0.0956 - lr: 1.6616e-06
Epoch 1/100
26/26 [==============================] - 5s 52ms/step - loss: 0.2325 - val_loss: 0.2198 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 22ms/step - loss: 0.2031 - val_loss: 0.1879 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1852 - val_loss: 0.1719 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1736 - val_loss: 0.1591 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1590 - val_loss: 0.1477 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1479 - val_loss: 0.1372 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1390 - val_loss: 0.1303 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1310 - val_loss: 0.1248 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1237 - val_loss: 0.1191 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 28ms/step - loss: 0.1173 - val_loss: 0.1130 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1094 - val_loss: 0.1041 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 27ms/step - loss: 0.1055 - val_loss: 0.1054 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 28ms/step - loss: 0.1020 - val_loss: 0.0961 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0970 - val_loss: 0.0979 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0946 - val_loss: 0.0928 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0928 - val_loss: 0.0940 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0933 - val_loss: 0.0931 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0944 - val_loss: 0.0906 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0938 - val_loss: 0.0855 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0899 - val_loss: 0.0834 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0882 - val_loss: 0.0824 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0867 - val_loss: 0.0866 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0822 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0813 - val_loss: 0.0856 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0790 - val_loss: 0.0846 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0785 - val_loss: 0.0846 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0778 - val_loss: 0.0826 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0776 - val_loss: 0.0844 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0771 - val_loss: 0.0828 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0773 - val_loss: 0.0830 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0768 - val_loss: 0.0830 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0770 - val_loss: 0.0828 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0770 - val_loss: 0.0828 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0762 - val_loss: 0.0827 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0763 - val_loss: 0.0824 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0761 - val_loss: 0.0826 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0761 - val_loss: 0.0825 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0768 - val_loss: 0.0825 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0760 - val_loss: 0.0825 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0764 - val_loss: 0.0825 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0759 - val_loss: 0.0825 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 7s 63ms/step - loss: 0.2303 - val_loss: 0.2000 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1880 - val_loss: 0.1938 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 37ms/step - loss: 0.1674 - val_loss: 0.1736 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 2s 53ms/step - loss: 0.1473 - val_loss: 0.1498 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 37ms/step - loss: 0.1330 - val_loss: 0.1324 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 2s 54ms/step - loss: 0.1208 - val_loss: 0.1226 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 2s 53ms/step - loss: 0.1118 - val_loss: 0.1138 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 42ms/step - loss: 0.1042 - val_loss: 0.1064 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0991 - val_loss: 0.1008 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0926 - val_loss: 0.0922 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0880 - val_loss: 0.0944 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0857 - val_loss: 0.0913 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0821 - val_loss: 0.0902 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0801 - val_loss: 0.0872 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0772 - val_loss: 0.0866 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0780 - val_loss: 0.0914 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0748 - val_loss: 0.0867 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0748 - val_loss: 0.0968 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0746 - val_loss: 0.0979 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0744 - val_loss: 0.0960 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0769 - val_loss: 0.1046 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0836 - val_loss: 0.0929 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0802 - val_loss: 0.0786 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0754 - val_loss: 0.0744 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0736 - val_loss: 0.0714 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0725 - val_loss: 0.0683 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0707 - val_loss: 0.0678 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0703 - val_loss: 0.0669 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0690 - val_loss: 0.0668 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0687 - val_loss: 0.0662 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0679 - val_loss: 0.0661 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0675 - val_loss: 0.0659 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0673 - val_loss: 0.0657 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0672 - val_loss: 0.0656 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0676 - val_loss: 0.0655 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0671 - val_loss: 0.0655 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0672 - val_loss: 0.0655 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0666 - val_loss: 0.0655 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0667 - val_loss: 0.0654 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0668 - val_loss: 0.0654 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0665 - val_loss: 0.0654 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0662 - val_loss: 0.0654 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0670 - val_loss: 0.0654 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0664 - val_loss: 0.0654 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0672 - val_loss: 0.0654 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0662 - val_loss: 0.0654 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0659 - val_loss: 0.0654 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0673 - val_loss: 0.0654 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0662 - val_loss: 0.0654 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0667 - val_loss: 0.0654 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0667 - val_loss: 0.0654 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0671 - val_loss: 0.0654 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0670 - val_loss: 0.0654 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0672 - val_loss: 0.0654 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0664 - val_loss: 0.0654 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0665 - val_loss: 0.0654 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0670 - val_loss: 0.0654 - lr: 2.5175e-12
Epoch 1/100
43/43 [==============================] - 4s 35ms/step - loss: 0.2421 - val_loss: 0.2057 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1919 - val_loss: 0.1806 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1638 - val_loss: 0.1632 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1458 - val_loss: 0.1520 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 16ms/step - loss: 0.1350 - val_loss: 0.1448 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1242 - val_loss: 0.1373 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1136 - val_loss: 0.1309 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 27ms/step - loss: 0.1071 - val_loss: 0.1255 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0989 - val_loss: 0.1203 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0961 - val_loss: 0.1168 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0930 - val_loss: 0.1126 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 16ms/step - loss: 0.0859 - val_loss: 0.1123 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0862 - val_loss: 0.1080 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0834 - val_loss: 0.1091 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0877 - val_loss: 0.1114 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0847 - val_loss: 0.1044 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0806 - val_loss: 0.1012 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0775 - val_loss: 0.0985 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0741 - val_loss: 0.0958 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0707 - val_loss: 0.0948 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0685 - val_loss: 0.0931 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0675 - val_loss: 0.0927 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0656 - val_loss: 0.0922 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0643 - val_loss: 0.0912 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0645 - val_loss: 0.0910 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0638 - val_loss: 0.0906 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0645 - val_loss: 0.0905 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0639 - val_loss: 0.0905 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0642 - val_loss: 0.0894 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0632 - val_loss: 0.0886 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0627 - val_loss: 0.0877 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0616 - val_loss: 0.0871 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0869 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0616 - val_loss: 0.0867 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0611 - val_loss: 0.0865 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0611 - val_loss: 0.0864 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0864 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0607 - val_loss: 0.0863 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0606 - val_loss: 0.0863 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0612 - val_loss: 0.0862 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0613 - val_loss: 0.0862 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0612 - val_loss: 0.0862 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0611 - val_loss: 0.0862 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0613 - val_loss: 0.0862 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0603 - val_loss: 0.0862 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0862 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0610 - val_loss: 0.0862 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0603 - val_loss: 0.0862 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 1.1370e-14
Average Validation Loss: 0.09285216629505158
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 5s 212ms/step - loss: 0.2456 - val_loss: 0.2663 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 39ms/step - loss: 0.2387 - val_loss: 0.2695 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 32ms/step - loss: 0.2362 - val_loss: 0.2598 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 35ms/step - loss: 0.2275 - val_loss: 0.2457 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 36ms/step - loss: 0.2122 - val_loss: 0.2352 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 32ms/step - loss: 0.2063 - val_loss: 0.2304 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 34ms/step - loss: 0.2054 - val_loss: 0.2288 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1974 - val_loss: 0.2289 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1914 - val_loss: 0.2281 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1897 - val_loss: 0.2240 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1831 - val_loss: 0.2182 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1786 - val_loss: 0.2122 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1696 - val_loss: 0.2076 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1665 - val_loss: 0.2055 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1640 - val_loss: 0.2033 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1569 - val_loss: 0.2008 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1526 - val_loss: 0.1934 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1470 - val_loss: 0.1917 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1418 - val_loss: 0.1942 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1398 - val_loss: 0.1905 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1341 - val_loss: 0.1900 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1315 - val_loss: 0.1864 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1275 - val_loss: 0.1885 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1279 - val_loss: 0.1911 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1288 - val_loss: 0.1871 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1259 - val_loss: 0.1869 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1251 - val_loss: 0.1869 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1235 - val_loss: 0.1873 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1247 - val_loss: 0.1862 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1239 - val_loss: 0.1867 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1232 - val_loss: 0.1867 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1232 - val_loss: 0.1862 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1232 - val_loss: 0.1861 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1232 - val_loss: 0.1861 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1228 - val_loss: 0.1861 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1237 - val_loss: 0.1861 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1229 - val_loss: 0.1862 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1226 - val_loss: 0.1862 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1224 - val_loss: 0.1863 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1229 - val_loss: 0.1863 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1236 - val_loss: 0.1863 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1229 - val_loss: 0.1862 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1245 - val_loss: 0.1862 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1218 - val_loss: 0.1862 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1216 - val_loss: 0.1862 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1248 - val_loss: 0.1862 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1227 - val_loss: 0.1862 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1217 - val_loss: 0.1862 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1233 - val_loss: 0.1862 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1226 - val_loss: 0.1862 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1223 - val_loss: 0.1862 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1225 - val_loss: 0.1862 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1224 - val_loss: 0.1862 - lr: 1.0130e-08
Epoch 1/100
9/9 [==============================] - 4s 151ms/step - loss: 0.2693 - val_loss: 0.2118 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 34ms/step - loss: 0.2427 - val_loss: 0.1966 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 32ms/step - loss: 0.2246 - val_loss: 0.2070 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 37ms/step - loss: 0.2121 - val_loss: 0.1748 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 33ms/step - loss: 0.2008 - val_loss: 0.1788 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1890 - val_loss: 0.1756 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1768 - val_loss: 0.1744 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1694 - val_loss: 0.1736 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1611 - val_loss: 0.1648 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1544 - val_loss: 0.1543 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1464 - val_loss: 0.1567 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1425 - val_loss: 0.1485 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1334 - val_loss: 0.1472 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1298 - val_loss: 0.1403 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1255 - val_loss: 0.1372 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1244 - val_loss: 0.1304 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1202 - val_loss: 0.1328 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1175 - val_loss: 0.1305 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1167 - val_loss: 0.1259 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1141 - val_loss: 0.1228 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1116 - val_loss: 0.1235 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1104 - val_loss: 0.1212 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1090 - val_loss: 0.1217 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1083 - val_loss: 0.1170 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1067 - val_loss: 0.1218 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1078 - val_loss: 0.1198 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1072 - val_loss: 0.1170 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1068 - val_loss: 0.1170 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1069 - val_loss: 0.1172 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1065 - val_loss: 0.1184 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1061 - val_loss: 0.1175 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1065 - val_loss: 0.1167 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1066 - val_loss: 0.1159 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1045 - val_loss: 0.1162 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1052 - val_loss: 0.1160 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1056 - val_loss: 0.1161 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1052 - val_loss: 0.1163 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1047 - val_loss: 0.1164 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1059 - val_loss: 0.1164 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1052 - val_loss: 0.1165 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1055 - val_loss: 0.1165 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1049 - val_loss: 0.1165 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1061 - val_loss: 0.1165 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1044 - val_loss: 0.1165 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1059 - val_loss: 0.1165 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1059 - val_loss: 0.1165 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1056 - val_loss: 0.1165 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1050 - val_loss: 0.1165 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1051 - val_loss: 0.1165 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1040 - val_loss: 0.1165 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1058 - val_loss: 0.1165 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1056 - val_loss: 0.1165 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1056 - val_loss: 0.1165 - lr: 1.0130e-08
Epoch 1/100
13/13 [==============================] - 4s 83ms/step - loss: 0.2762 - val_loss: 0.2401 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 23ms/step - loss: 0.2293 - val_loss: 0.2317 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.2092 - val_loss: 0.2147 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1908 - val_loss: 0.1893 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1773 - val_loss: 0.1680 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1678 - val_loss: 0.1576 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 23ms/step - loss: 0.1560 - val_loss: 0.1540 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1480 - val_loss: 0.1489 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1416 - val_loss: 0.1412 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1338 - val_loss: 0.1327 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1311 - val_loss: 0.1318 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1228 - val_loss: 0.1245 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1176 - val_loss: 0.1195 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1150 - val_loss: 0.1160 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1105 - val_loss: 0.1133 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1063 - val_loss: 0.1090 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1023 - val_loss: 0.1046 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1031 - val_loss: 0.1024 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1013 - val_loss: 0.1028 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0983 - val_loss: 0.1022 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0946 - val_loss: 0.1000 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0935 - val_loss: 0.0965 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0932 - val_loss: 0.0967 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0913 - val_loss: 0.0955 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0909 - val_loss: 0.0960 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0899 - val_loss: 0.0949 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0895 - val_loss: 0.0943 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0892 - val_loss: 0.0943 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0885 - val_loss: 0.0931 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0886 - val_loss: 0.0939 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0876 - val_loss: 0.0931 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0876 - val_loss: 0.0932 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0880 - val_loss: 0.0931 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0876 - val_loss: 0.0930 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0877 - val_loss: 0.0931 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0884 - val_loss: 0.0932 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0874 - val_loss: 0.0931 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0878 - val_loss: 0.0930 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0873 - val_loss: 0.0930 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.0930 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0879 - val_loss: 0.0929 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0872 - val_loss: 0.0929 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0866 - val_loss: 0.0929 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0887 - val_loss: 0.0929 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0870 - val_loss: 0.0929 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0878 - val_loss: 0.0929 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0867 - val_loss: 0.0929 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0929 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0877 - val_loss: 0.0929 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0873 - val_loss: 0.0929 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0869 - val_loss: 0.0929 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0862 - val_loss: 0.0929 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0869 - val_loss: 0.0929 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0878 - val_loss: 0.0929 - lr: 5.0565e-11
Epoch 64/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0929 - lr: 2.7751e-11
Epoch 65/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0876 - val_loss: 0.0929 - lr: 1.5230e-11
Epoch 66/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0876 - val_loss: 0.0929 - lr: 8.3584e-12
Epoch 67/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0870 - val_loss: 0.0929 - lr: 4.5872e-12
Epoch 68/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0882 - val_loss: 0.0929 - lr: 2.5175e-12
Epoch 69/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0870 - val_loss: 0.0929 - lr: 1.3816e-12
Epoch 1/100
17/17 [==============================] - 5s 113ms/step - loss: 0.2459 - val_loss: 0.2214 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 30ms/step - loss: 0.2187 - val_loss: 0.2050 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1957 - val_loss: 0.1905 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 30ms/step - loss: 0.1791 - val_loss: 0.2096 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1758 - val_loss: 0.2173 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 29ms/step - loss: 0.1744 - val_loss: 0.1511 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1459 - val_loss: 0.1541 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 29ms/step - loss: 0.1372 - val_loss: 0.1657 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1305 - val_loss: 0.1577 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1287 - val_loss: 0.1735 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1403 - val_loss: 0.1421 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1297 - val_loss: 0.1130 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1097 - val_loss: 0.1339 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1110 - val_loss: 0.1354 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1158 - val_loss: 0.1219 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 30ms/step - loss: 0.1128 - val_loss: 0.0956 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0958 - val_loss: 0.0962 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0925 - val_loss: 0.1041 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0931 - val_loss: 0.1071 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0961 - val_loss: 0.1041 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0970 - val_loss: 0.0847 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0892 - val_loss: 0.0828 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0870 - val_loss: 0.0820 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0853 - val_loss: 0.0813 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0847 - val_loss: 0.0808 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0807 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0844 - val_loss: 0.0802 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0838 - val_loss: 0.0795 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0834 - val_loss: 0.0794 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0831 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0788 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0824 - val_loss: 0.0787 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0828 - val_loss: 0.0787 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0829 - val_loss: 0.0788 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0830 - val_loss: 0.0787 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0787 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0825 - val_loss: 0.0786 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0826 - val_loss: 0.0786 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0821 - val_loss: 0.0786 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0820 - val_loss: 0.0786 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0833 - val_loss: 0.0785 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0785 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0785 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0819 - val_loss: 0.0785 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0820 - val_loss: 0.0785 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0814 - val_loss: 0.0785 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0827 - val_loss: 0.0785 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0833 - val_loss: 0.0785 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0830 - val_loss: 0.0785 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0829 - val_loss: 0.0785 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0817 - val_loss: 0.0785 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0818 - val_loss: 0.0785 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0832 - val_loss: 0.0785 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0829 - val_loss: 0.0785 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0824 - val_loss: 0.0785 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0822 - val_loss: 0.0785 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0827 - val_loss: 0.0785 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0818 - val_loss: 0.0785 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0822 - val_loss: 0.0785 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0827 - val_loss: 0.0785 - lr: 2.2897e-14
Epoch 1/100
22/22 [==============================] - 4s 70ms/step - loss: 0.2482 - val_loss: 0.2196 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.2137 - val_loss: 0.2052 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 31ms/step - loss: 0.1935 - val_loss: 0.1897 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 30ms/step - loss: 0.1790 - val_loss: 0.1783 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1670 - val_loss: 0.1668 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 25ms/step - loss: 0.1552 - val_loss: 0.1575 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1452 - val_loss: 0.1505 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1404 - val_loss: 0.1453 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1340 - val_loss: 0.1398 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1279 - val_loss: 0.1353 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1233 - val_loss: 0.1319 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1168 - val_loss: 0.1271 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1117 - val_loss: 0.1226 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1089 - val_loss: 0.1221 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1063 - val_loss: 0.1212 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1020 - val_loss: 0.1168 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0977 - val_loss: 0.1128 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0950 - val_loss: 0.1124 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0918 - val_loss: 0.1090 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0887 - val_loss: 0.1061 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0862 - val_loss: 0.1036 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0826 - val_loss: 0.1029 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0816 - val_loss: 0.0979 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0794 - val_loss: 0.0940 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0765 - val_loss: 0.0890 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0749 - val_loss: 0.0864 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0732 - val_loss: 0.0862 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0734 - val_loss: 0.0851 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0728 - val_loss: 0.0845 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0726 - val_loss: 0.0845 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0724 - val_loss: 0.0844 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0723 - val_loss: 0.0840 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0723 - val_loss: 0.0838 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0724 - val_loss: 0.0837 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0713 - val_loss: 0.0836 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0836 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0721 - val_loss: 0.0835 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0835 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0727 - val_loss: 0.0835 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0722 - val_loss: 0.0834 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0715 - val_loss: 0.0834 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0721 - val_loss: 0.0834 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0717 - val_loss: 0.0834 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0722 - val_loss: 0.0834 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0719 - val_loss: 0.0834 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0725 - val_loss: 0.0834 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0834 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0834 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0717 - val_loss: 0.0834 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0834 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0717 - val_loss: 0.0834 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0715 - val_loss: 0.0834 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0721 - val_loss: 0.0834 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0720 - val_loss: 0.0834 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0719 - val_loss: 0.0834 - lr: 5.0565e-11
Average Validation Loss: 0.11137318760156631
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 62ms/step - loss: 0.2260 - val_loss: 0.2699 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 17ms/step - loss: 0.2333 - val_loss: 0.2148 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1932 - val_loss: 0.2075 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1897 - val_loss: 0.1951 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1690 - val_loss: 0.1951 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1687 - val_loss: 0.1765 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1314 - val_loss: 0.2186 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1643 - val_loss: 0.1603 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1221 - val_loss: 0.1527 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 16ms/step - loss: 0.1154 - val_loss: 0.1550 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1107 - val_loss: 0.1383 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1019 - val_loss: 0.1461 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 16ms/step - loss: 0.1006 - val_loss: 0.1618 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0989 - val_loss: 0.1547 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0922 - val_loss: 0.1314 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0893 - val_loss: 0.1371 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0868 - val_loss: 0.1447 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0881 - val_loss: 0.1275 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0861 - val_loss: 0.1316 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0833 - val_loss: 0.1408 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0846 - val_loss: 0.1299 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0798 - val_loss: 0.1297 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0820 - val_loss: 0.1347 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0794 - val_loss: 0.1278 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0779 - val_loss: 0.1325 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0787 - val_loss: 0.1289 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0768 - val_loss: 0.1289 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0772 - val_loss: 0.1282 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0775 - val_loss: 0.1286 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0771 - val_loss: 0.1290 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0781 - val_loss: 0.1285 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0767 - val_loss: 0.1270 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0762 - val_loss: 0.1264 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0765 - val_loss: 0.1272 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0766 - val_loss: 0.1268 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0759 - val_loss: 0.1272 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0762 - val_loss: 0.1272 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0763 - val_loss: 0.1270 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0757 - val_loss: 0.1271 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0763 - val_loss: 0.1270 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0759 - val_loss: 0.1268 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0750 - val_loss: 0.1267 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0763 - val_loss: 0.1268 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0765 - val_loss: 0.1268 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0765 - val_loss: 0.1268 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0772 - val_loss: 0.1267 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0772 - val_loss: 0.1267 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0777 - val_loss: 0.1267 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0760 - val_loss: 0.1267 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0762 - val_loss: 0.1267 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0769 - val_loss: 0.1267 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0767 - val_loss: 0.1267 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0759 - val_loss: 0.1267 - lr: 1.0130e-08
Epoch 1/100
34/34 [==============================] - 4s 48ms/step - loss: 0.2270 - val_loss: 0.1878 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 16ms/step - loss: 0.2100 - val_loss: 0.1494 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1900 - val_loss: 0.1465 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1766 - val_loss: 0.1223 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1633 - val_loss: 0.1267 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1554 - val_loss: 0.1071 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1470 - val_loss: 0.1180 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 11ms/step - loss: 0.1408 - val_loss: 0.0967 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1382 - val_loss: 0.1205 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1290 - val_loss: 0.0897 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1255 - val_loss: 0.1236 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1116 - val_loss: 0.1153 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1092 - val_loss: 0.0901 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1096 - val_loss: 0.1003 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1014 - val_loss: 0.1028 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1032 - val_loss: 0.0875 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0960 - val_loss: 0.0835 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0898 - val_loss: 0.0785 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0877 - val_loss: 0.0776 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0826 - val_loss: 0.0763 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 11ms/step - loss: 0.0787 - val_loss: 0.0763 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0754 - val_loss: 0.0746 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0731 - val_loss: 0.0754 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 11ms/step - loss: 0.0714 - val_loss: 0.0775 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0708 - val_loss: 0.0802 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0675 - val_loss: 0.0783 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0672 - val_loss: 0.0802 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0681 - val_loss: 0.0796 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0660 - val_loss: 0.0802 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0650 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0656 - val_loss: 0.0789 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0656 - val_loss: 0.0800 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0662 - val_loss: 0.0799 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0657 - val_loss: 0.0804 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0657 - val_loss: 0.0800 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0641 - val_loss: 0.0802 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0650 - val_loss: 0.0803 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0655 - val_loss: 0.0803 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0645 - val_loss: 0.0802 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0649 - val_loss: 0.0803 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0650 - val_loss: 0.0803 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0651 - val_loss: 0.0803 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 5s 36ms/step - loss: 0.2191 - val_loss: 0.1957 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1868 - val_loss: 0.1666 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1675 - val_loss: 0.1510 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1515 - val_loss: 0.1372 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1421 - val_loss: 0.1285 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1360 - val_loss: 0.1239 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1298 - val_loss: 0.1205 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1254 - val_loss: 0.1150 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1191 - val_loss: 0.1059 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 14ms/step - loss: 0.1180 - val_loss: 0.1081 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 14ms/step - loss: 0.1065 - val_loss: 0.0920 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1074 - val_loss: 0.0970 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0937 - val_loss: 0.0818 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0975 - val_loss: 0.0911 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0858 - val_loss: 0.0764 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0808 - val_loss: 0.0728 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0772 - val_loss: 0.0708 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0728 - val_loss: 0.0667 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0688 - val_loss: 0.0657 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0671 - val_loss: 0.0647 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 13ms/step - loss: 0.0637 - val_loss: 0.0630 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0615 - val_loss: 0.0627 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0610 - val_loss: 0.0619 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0608 - val_loss: 0.0618 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0605 - val_loss: 0.0603 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0613 - val_loss: 0.0597 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0597 - val_loss: 0.0597 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0599 - val_loss: 0.0614 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0584 - val_loss: 0.0609 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 13ms/step - loss: 0.0578 - val_loss: 0.0616 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0566 - val_loss: 0.0621 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0564 - val_loss: 0.0621 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0561 - val_loss: 0.0623 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0559 - val_loss: 0.0621 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0556 - val_loss: 0.0618 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0550 - val_loss: 0.0617 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0620 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0553 - val_loss: 0.0621 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0552 - val_loss: 0.0619 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0620 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0560 - val_loss: 0.0620 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0552 - val_loss: 0.0620 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0555 - val_loss: 0.0621 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0556 - val_loss: 0.0621 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0557 - val_loss: 0.0621 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 13ms/step - loss: 0.0562 - val_loss: 0.0621 - lr: 2.2487e-07
Epoch 1/100
68/68 [==============================] - 4s 24ms/step - loss: 0.2143 - val_loss: 0.2137 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1796 - val_loss: 0.1816 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1553 - val_loss: 0.1707 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1457 - val_loss: 0.1525 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1309 - val_loss: 0.1387 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1244 - val_loss: 0.1364 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1163 - val_loss: 0.1228 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 2s 26ms/step - loss: 0.1082 - val_loss: 0.1324 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1024 - val_loss: 0.1375 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0986 - val_loss: 0.1224 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0923 - val_loss: 0.1148 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0866 - val_loss: 0.0998 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0820 - val_loss: 0.0944 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0781 - val_loss: 0.0915 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0742 - val_loss: 0.0882 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0731 - val_loss: 0.0864 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0703 - val_loss: 0.0845 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0698 - val_loss: 0.0822 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0661 - val_loss: 0.0805 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0662 - val_loss: 0.0810 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0648 - val_loss: 0.0801 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0629 - val_loss: 0.0830 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0627 - val_loss: 0.0809 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0628 - val_loss: 0.0844 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0642 - val_loss: 0.0800 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0639 - val_loss: 0.0766 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0636 - val_loss: 0.0718 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0624 - val_loss: 0.0685 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0625 - val_loss: 0.0655 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0598 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0601 - val_loss: 0.0638 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0628 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0587 - val_loss: 0.0626 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0588 - val_loss: 0.0624 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0588 - val_loss: 0.0622 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0579 - val_loss: 0.0621 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0576 - val_loss: 0.0620 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0580 - val_loss: 0.0619 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0580 - val_loss: 0.0618 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0575 - val_loss: 0.0618 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0581 - val_loss: 0.0618 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0578 - val_loss: 0.0618 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0580 - val_loss: 0.0618 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0572 - val_loss: 0.0618 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0580 - val_loss: 0.0617 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0576 - val_loss: 0.0617 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0574 - val_loss: 0.0617 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0571 - val_loss: 0.0617 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0581 - val_loss: 0.0617 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0576 - val_loss: 0.0617 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0617 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0617 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0617 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0581 - val_loss: 0.0617 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0583 - val_loss: 0.0617 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0574 - val_loss: 0.0617 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0572 - val_loss: 0.0617 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0571 - val_loss: 0.0617 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0582 - val_loss: 0.0617 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0572 - val_loss: 0.0617 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0569 - val_loss: 0.0617 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0572 - val_loss: 0.0617 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0568 - val_loss: 0.0617 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 5s 23ms/step - loss: 0.2082 - val_loss: 0.1724 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1608 - val_loss: 0.1424 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1405 - val_loss: 0.1301 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1280 - val_loss: 0.1218 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1192 - val_loss: 0.1169 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1087 - val_loss: 0.1108 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1047 - val_loss: 0.1078 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0993 - val_loss: 0.1040 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0924 - val_loss: 0.1041 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0915 - val_loss: 0.0953 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0839 - val_loss: 0.0912 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0755 - val_loss: 0.0878 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0718 - val_loss: 0.0838 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0687 - val_loss: 0.0813 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0656 - val_loss: 0.0794 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0640 - val_loss: 0.0791 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0643 - val_loss: 0.0764 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0608 - val_loss: 0.0737 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0588 - val_loss: 0.0721 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0560 - val_loss: 0.0718 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0555 - val_loss: 0.0701 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0528 - val_loss: 0.0683 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0511 - val_loss: 0.0673 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0497 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0490 - val_loss: 0.0656 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0473 - val_loss: 0.0651 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0476 - val_loss: 0.0645 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0466 - val_loss: 0.0643 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0462 - val_loss: 0.0639 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0459 - val_loss: 0.0639 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0458 - val_loss: 0.0635 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0630 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0628 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0449 - val_loss: 0.0626 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0452 - val_loss: 0.0625 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0624 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0452 - val_loss: 0.0624 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0453 - val_loss: 0.0623 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0622 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0447 - val_loss: 0.0622 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0622 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0450 - val_loss: 0.0622 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0622 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0447 - val_loss: 0.0622 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0451 - val_loss: 0.0621 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0457 - val_loss: 0.0621 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0451 - val_loss: 0.0621 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0446 - val_loss: 0.0621 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0449 - val_loss: 0.0621 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0621 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0453 - val_loss: 0.0621 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0453 - val_loss: 0.0621 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 3s 37ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0451 - val_loss: 0.0621 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 3s 34ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0450 - val_loss: 0.0621 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0446 - val_loss: 0.0621 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0450 - val_loss: 0.0621 - lr: 1.1370e-14
Average Validation Loss: 0.07689967826008796
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 133ms/step - loss: 0.2231 - val_loss: 0.2408 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.2169 - val_loss: 0.2400 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.2081 - val_loss: 0.2202 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1950 - val_loss: 0.2126 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1854 - val_loss: 0.2075 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1799 - val_loss: 0.2016 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1715 - val_loss: 0.1949 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1624 - val_loss: 0.1824 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1454 - val_loss: 0.1713 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1300 - val_loss: 0.1599 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1221 - val_loss: 0.1651 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1236 - val_loss: 0.1745 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1283 - val_loss: 0.1464 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1078 - val_loss: 0.1533 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1098 - val_loss: 0.1538 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1083 - val_loss: 0.1414 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1014 - val_loss: 0.1462 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1013 - val_loss: 0.1453 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0982 - val_loss: 0.1415 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0970 - val_loss: 0.1419 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0994 - val_loss: 0.1403 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0957 - val_loss: 0.1407 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0952 - val_loss: 0.1388 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0959 - val_loss: 0.1369 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0936 - val_loss: 0.1364 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0930 - val_loss: 0.1399 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0931 - val_loss: 0.1376 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0928 - val_loss: 0.1364 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0935 - val_loss: 0.1365 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0919 - val_loss: 0.1375 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0932 - val_loss: 0.1379 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0913 - val_loss: 0.1380 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0930 - val_loss: 0.1375 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0916 - val_loss: 0.1375 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0928 - val_loss: 0.1373 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0930 - val_loss: 0.1372 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0917 - val_loss: 0.1370 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0921 - val_loss: 0.1368 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0918 - val_loss: 0.1367 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0937 - val_loss: 0.1366 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0918 - val_loss: 0.1366 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0925 - val_loss: 0.1366 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0933 - val_loss: 0.1366 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0918 - val_loss: 0.1366 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0927 - val_loss: 0.1365 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0928 - val_loss: 0.1365 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0932 - val_loss: 0.1365 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0919 - val_loss: 0.1365 - lr: 1.0104e-07
Epoch 1/100
17/17 [==============================] - 4s 62ms/step - loss: 0.2738 - val_loss: 0.1894 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 17ms/step - loss: 0.2233 - val_loss: 0.1786 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 17ms/step - loss: 0.2073 - val_loss: 0.1622 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1928 - val_loss: 0.1520 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1815 - val_loss: 0.1485 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1733 - val_loss: 0.1342 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1607 - val_loss: 0.1349 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1458 - val_loss: 0.1414 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1450 - val_loss: 0.1138 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1362 - val_loss: 0.1247 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1224 - val_loss: 0.1313 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1296 - val_loss: 0.1032 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1228 - val_loss: 0.1060 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1079 - val_loss: 0.1208 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1048 - val_loss: 0.1114 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1062 - val_loss: 0.1019 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1012 - val_loss: 0.1001 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0953 - val_loss: 0.1018 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0930 - val_loss: 0.1020 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0938 - val_loss: 0.0966 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0910 - val_loss: 0.0975 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0891 - val_loss: 0.0967 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0874 - val_loss: 0.0977 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0870 - val_loss: 0.0980 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0870 - val_loss: 0.0958 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0856 - val_loss: 0.0988 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0856 - val_loss: 0.0964 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0857 - val_loss: 0.0966 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0847 - val_loss: 0.0970 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0849 - val_loss: 0.0968 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0853 - val_loss: 0.0968 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0851 - val_loss: 0.0977 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0840 - val_loss: 0.0973 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0837 - val_loss: 0.0966 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0848 - val_loss: 0.0966 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0845 - val_loss: 0.0970 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0854 - val_loss: 0.0967 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0839 - val_loss: 0.0967 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0841 - val_loss: 0.0968 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0843 - val_loss: 0.0967 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0837 - val_loss: 0.0967 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0838 - val_loss: 0.0967 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0845 - val_loss: 0.0967 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0840 - val_loss: 0.0968 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0842 - val_loss: 0.0968 - lr: 3.3546e-07
Epoch 1/100
26/26 [==============================] - 5s 54ms/step - loss: 0.2245 - val_loss: 0.2163 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1993 - val_loss: 0.1924 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1793 - val_loss: 0.1748 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 29ms/step - loss: 0.1654 - val_loss: 0.1552 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1543 - val_loss: 0.1447 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1451 - val_loss: 0.1354 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1348 - val_loss: 0.1305 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1263 - val_loss: 0.1214 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1201 - val_loss: 0.1194 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1098 - val_loss: 0.0997 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1070 - val_loss: 0.1082 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0987 - val_loss: 0.0945 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0936 - val_loss: 0.0929 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0882 - val_loss: 0.0861 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0865 - val_loss: 0.0875 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0822 - val_loss: 0.0818 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0811 - val_loss: 0.0847 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0798 - val_loss: 0.0822 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0795 - val_loss: 0.0831 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0793 - val_loss: 0.0824 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0784 - val_loss: 0.0807 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0799 - val_loss: 0.0780 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0784 - val_loss: 0.0787 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0753 - val_loss: 0.0790 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0746 - val_loss: 0.0782 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0728 - val_loss: 0.0786 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0717 - val_loss: 0.0781 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0708 - val_loss: 0.0774 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0702 - val_loss: 0.0776 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0710 - val_loss: 0.0770 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0707 - val_loss: 0.0776 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0705 - val_loss: 0.0769 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0700 - val_loss: 0.0769 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0696 - val_loss: 0.0770 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0700 - val_loss: 0.0769 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0700 - val_loss: 0.0770 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0697 - val_loss: 0.0771 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0699 - val_loss: 0.0772 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0772 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0692 - val_loss: 0.0771 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0693 - val_loss: 0.0771 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0696 - val_loss: 0.0771 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0697 - val_loss: 0.0770 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0688 - val_loss: 0.0770 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0694 - val_loss: 0.0770 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0697 - val_loss: 0.0770 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0697 - val_loss: 0.0770 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0705 - val_loss: 0.0770 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0704 - val_loss: 0.0770 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0691 - val_loss: 0.0770 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0694 - val_loss: 0.0770 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0693 - val_loss: 0.0770 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0695 - val_loss: 0.0770 - lr: 1.0130e-08
Epoch 1/100
34/34 [==============================] - 5s 47ms/step - loss: 0.2209 - val_loss: 0.1964 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1882 - val_loss: 0.1942 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1712 - val_loss: 0.1689 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1542 - val_loss: 0.1541 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1415 - val_loss: 0.1461 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1307 - val_loss: 0.1383 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1232 - val_loss: 0.1384 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1168 - val_loss: 0.1278 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1106 - val_loss: 0.1205 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1063 - val_loss: 0.1188 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1001 - val_loss: 0.1103 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0938 - val_loss: 0.1044 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0916 - val_loss: 0.1027 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0885 - val_loss: 0.1041 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0859 - val_loss: 0.0999 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0840 - val_loss: 0.1049 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0835 - val_loss: 0.1052 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0832 - val_loss: 0.1099 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0838 - val_loss: 0.1089 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0867 - val_loss: 0.1256 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0986 - val_loss: 0.1041 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0916 - val_loss: 0.0904 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0843 - val_loss: 0.0863 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0833 - val_loss: 0.0789 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0801 - val_loss: 0.0751 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0772 - val_loss: 0.0725 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0706 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0751 - val_loss: 0.0693 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0734 - val_loss: 0.0684 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0737 - val_loss: 0.0674 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0721 - val_loss: 0.0669 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0722 - val_loss: 0.0667 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0715 - val_loss: 0.0665 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0713 - val_loss: 0.0664 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0711 - val_loss: 0.0661 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0715 - val_loss: 0.0660 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0708 - val_loss: 0.0660 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0711 - val_loss: 0.0659 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0717 - val_loss: 0.0659 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0716 - val_loss: 0.0658 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0705 - val_loss: 0.0658 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0701 - val_loss: 0.0658 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0704 - val_loss: 0.0658 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0709 - val_loss: 0.0658 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0699 - val_loss: 0.0658 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0709 - val_loss: 0.0658 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0716 - val_loss: 0.0658 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0701 - val_loss: 0.0658 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0712 - val_loss: 0.0658 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0702 - val_loss: 0.0658 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0709 - val_loss: 0.0658 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0718 - val_loss: 0.0658 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0704 - val_loss: 0.0658 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0702 - val_loss: 0.0658 - lr: 1.1370e-14
Epoch 1/100
43/43 [==============================] - 4s 39ms/step - loss: 0.2130 - val_loss: 0.1923 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1767 - val_loss: 0.1724 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1543 - val_loss: 0.1575 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1364 - val_loss: 0.1445 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 27ms/step - loss: 0.1233 - val_loss: 0.1384 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1178 - val_loss: 0.1312 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1105 - val_loss: 0.1273 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1035 - val_loss: 0.1245 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0997 - val_loss: 0.1207 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0993 - val_loss: 0.1245 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0969 - val_loss: 0.1114 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0903 - val_loss: 0.1088 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0866 - val_loss: 0.1042 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0824 - val_loss: 0.1001 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0774 - val_loss: 0.0988 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0753 - val_loss: 0.0951 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0725 - val_loss: 0.0943 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0720 - val_loss: 0.0905 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0683 - val_loss: 0.0885 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0675 - val_loss: 0.0864 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0651 - val_loss: 0.0846 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0634 - val_loss: 0.0833 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0618 - val_loss: 0.0822 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0612 - val_loss: 0.0813 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0807 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0597 - val_loss: 0.0797 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0598 - val_loss: 0.0795 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0605 - val_loss: 0.0783 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0602 - val_loss: 0.0772 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0601 - val_loss: 0.0765 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0595 - val_loss: 0.0760 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0586 - val_loss: 0.0758 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0590 - val_loss: 0.0757 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0586 - val_loss: 0.0756 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0582 - val_loss: 0.0755 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0754 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0585 - val_loss: 0.0753 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0571 - val_loss: 0.0753 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0753 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0575 - val_loss: 0.0753 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0582 - val_loss: 0.0753 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0753 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0572 - val_loss: 0.0753 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0573 - val_loss: 0.0753 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0572 - val_loss: 0.0753 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0584 - val_loss: 0.0753 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0576 - val_loss: 0.0753 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0575 - val_loss: 0.0753 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0586 - val_loss: 0.0753 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0576 - val_loss: 0.0753 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0575 - val_loss: 0.0753 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0570 - val_loss: 0.0753 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0585 - val_loss: 0.0753 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 2.2897e-14
Average Validation Loss: 0.09000384658575059
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 215ms/step - loss: 0.2156 - val_loss: 0.2508 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 40ms/step - loss: 0.2175 - val_loss: 0.2549 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 37ms/step - loss: 0.2135 - val_loss: 0.2424 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 39ms/step - loss: 0.2035 - val_loss: 0.2293 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1956 - val_loss: 0.2209 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1859 - val_loss: 0.2186 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1754 - val_loss: 0.2210 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1695 - val_loss: 0.2131 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1553 - val_loss: 0.2132 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1486 - val_loss: 0.2145 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1443 - val_loss: 0.2013 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1349 - val_loss: 0.2032 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1311 - val_loss: 0.1945 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1262 - val_loss: 0.1875 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1252 - val_loss: 0.1986 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1228 - val_loss: 0.1806 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1193 - val_loss: 0.1997 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1198 - val_loss: 0.1792 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1179 - val_loss: 0.1828 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1139 - val_loss: 0.1864 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1153 - val_loss: 0.1796 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1133 - val_loss: 0.1782 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1119 - val_loss: 0.1815 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1137 - val_loss: 0.1787 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1122 - val_loss: 0.1756 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1120 - val_loss: 0.1775 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1115 - val_loss: 0.1789 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1126 - val_loss: 0.1793 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1110 - val_loss: 0.1778 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1106 - val_loss: 0.1760 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1111 - val_loss: 0.1757 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1111 - val_loss: 0.1760 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1100 - val_loss: 0.1764 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1087 - val_loss: 0.1766 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1114 - val_loss: 0.1769 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 59ms/step - loss: 0.1109 - val_loss: 0.1772 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1106 - val_loss: 0.1773 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1098 - val_loss: 0.1773 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1105 - val_loss: 0.1774 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1105 - val_loss: 0.1774 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1117 - val_loss: 0.1774 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1112 - val_loss: 0.1774 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1102 - val_loss: 0.1774 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1106 - val_loss: 0.1774 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1096 - val_loss: 0.1774 - lr: 3.3546e-07
Epoch 1/100
9/9 [==============================] - 5s 168ms/step - loss: 0.2624 - val_loss: 0.1912 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 39ms/step - loss: 0.2306 - val_loss: 0.1773 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 39ms/step - loss: 0.2159 - val_loss: 0.1870 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 38ms/step - loss: 0.2059 - val_loss: 0.1700 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1971 - val_loss: 0.1572 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1895 - val_loss: 0.1591 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1792 - val_loss: 0.1601 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1695 - val_loss: 0.1605 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1633 - val_loss: 0.1581 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1576 - val_loss: 0.1493 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1459 - val_loss: 0.1477 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1412 - val_loss: 0.1459 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1353 - val_loss: 0.1485 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1304 - val_loss: 0.1337 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1242 - val_loss: 0.1434 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1224 - val_loss: 0.1351 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1204 - val_loss: 0.1381 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1182 - val_loss: 0.1309 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1156 - val_loss: 0.1358 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1139 - val_loss: 0.1309 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1123 - val_loss: 0.1304 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1117 - val_loss: 0.1299 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1102 - val_loss: 0.1262 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1098 - val_loss: 0.1283 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1082 - val_loss: 0.1265 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1082 - val_loss: 0.1258 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 52ms/step - loss: 0.1081 - val_loss: 0.1264 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1074 - val_loss: 0.1254 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1069 - val_loss: 0.1232 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1064 - val_loss: 0.1254 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1072 - val_loss: 0.1261 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1064 - val_loss: 0.1263 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1077 - val_loss: 0.1260 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1066 - val_loss: 0.1261 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 55ms/step - loss: 0.1074 - val_loss: 0.1256 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1070 - val_loss: 0.1253 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1059 - val_loss: 0.1249 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1063 - val_loss: 0.1247 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 52ms/step - loss: 0.1072 - val_loss: 0.1245 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1063 - val_loss: 0.1245 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1066 - val_loss: 0.1245 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1067 - val_loss: 0.1245 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1066 - val_loss: 0.1245 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1062 - val_loss: 0.1245 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1074 - val_loss: 0.1245 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1068 - val_loss: 0.1245 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1071 - val_loss: 0.1245 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1068 - val_loss: 0.1245 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1049 - val_loss: 0.1245 - lr: 6.7729e-08
Epoch 1/100
13/13 [==============================] - 5s 94ms/step - loss: 0.2244 - val_loss: 0.2153 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 28ms/step - loss: 0.2084 - val_loss: 0.2088 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1875 - val_loss: 0.1864 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1819 - val_loss: 0.1709 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1691 - val_loss: 0.1645 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 33ms/step - loss: 0.1578 - val_loss: 0.1454 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1513 - val_loss: 0.1320 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1468 - val_loss: 0.1275 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1379 - val_loss: 0.1314 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1285 - val_loss: 0.1221 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 35ms/step - loss: 0.1178 - val_loss: 0.1067 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1123 - val_loss: 0.1018 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1071 - val_loss: 0.0973 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1058 - val_loss: 0.0938 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1093 - val_loss: 0.0988 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1088 - val_loss: 0.1206 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1000 - val_loss: 0.1051 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0959 - val_loss: 0.0974 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0945 - val_loss: 0.0968 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0948 - val_loss: 0.1015 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0909 - val_loss: 0.0944 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0904 - val_loss: 0.0929 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0901 - val_loss: 0.0931 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0887 - val_loss: 0.0916 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0887 - val_loss: 0.0934 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0878 - val_loss: 0.0922 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0878 - val_loss: 0.0909 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0866 - val_loss: 0.0931 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0865 - val_loss: 0.0907 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0864 - val_loss: 0.0908 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0871 - val_loss: 0.0909 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0859 - val_loss: 0.0908 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0866 - val_loss: 0.0911 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0858 - val_loss: 0.0910 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0861 - val_loss: 0.0910 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0855 - val_loss: 0.0907 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0864 - val_loss: 0.0907 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0868 - val_loss: 0.0907 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0854 - val_loss: 0.0907 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0867 - val_loss: 0.0907 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0857 - val_loss: 0.0907 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0854 - val_loss: 0.0907 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 47ms/step - loss: 0.0856 - val_loss: 0.0907 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0865 - val_loss: 0.0907 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0856 - val_loss: 0.0907 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0861 - val_loss: 0.0907 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0854 - val_loss: 0.0907 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0859 - val_loss: 0.0907 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 1s 48ms/step - loss: 0.0864 - val_loss: 0.0907 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0866 - val_loss: 0.0907 - lr: 5.0435e-10
Epoch 1/100
17/17 [==============================] - 7s 111ms/step - loss: 0.2293 - val_loss: 0.2103 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 30ms/step - loss: 0.2015 - val_loss: 0.2015 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 33ms/step - loss: 0.1850 - val_loss: 0.1899 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1734 - val_loss: 0.2008 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1702 - val_loss: 0.1652 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 1s 30ms/step - loss: 0.1543 - val_loss: 0.1468 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1377 - val_loss: 0.1527 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 29ms/step - loss: 0.1305 - val_loss: 0.1409 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1227 - val_loss: 0.1348 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1168 - val_loss: 0.1313 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1139 - val_loss: 0.1388 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1176 - val_loss: 0.1534 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 33ms/step - loss: 0.1292 - val_loss: 0.1075 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 33ms/step - loss: 0.1104 - val_loss: 0.1024 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1047 - val_loss: 0.1045 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1041 - val_loss: 0.0994 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1025 - val_loss: 0.0928 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0984 - val_loss: 0.0889 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0954 - val_loss: 0.0863 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0923 - val_loss: 0.0868 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0906 - val_loss: 0.0844 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0894 - val_loss: 0.0818 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0885 - val_loss: 0.0823 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0876 - val_loss: 0.0818 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0870 - val_loss: 0.0811 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0858 - val_loss: 0.0805 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0858 - val_loss: 0.0800 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0857 - val_loss: 0.0803 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0852 - val_loss: 0.0796 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0846 - val_loss: 0.0801 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0849 - val_loss: 0.0798 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0842 - val_loss: 0.0794 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0849 - val_loss: 0.0795 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0845 - val_loss: 0.0795 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0843 - val_loss: 0.0794 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0834 - val_loss: 0.0793 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0841 - val_loss: 0.0794 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0849 - val_loss: 0.0793 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0845 - val_loss: 0.0793 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0840 - val_loss: 0.0793 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0840 - val_loss: 0.0793 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0837 - val_loss: 0.0793 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0843 - val_loss: 0.0793 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0837 - val_loss: 0.0793 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0846 - val_loss: 0.0793 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0843 - val_loss: 0.0793 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0842 - val_loss: 0.0793 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0839 - val_loss: 0.0793 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0835 - val_loss: 0.0793 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 29ms/step - loss: 0.0847 - val_loss: 0.0793 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0849 - val_loss: 0.0793 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0842 - val_loss: 0.0793 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0845 - val_loss: 0.0793 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0848 - val_loss: 0.0793 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0840 - val_loss: 0.0793 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0843 - val_loss: 0.0793 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0852 - val_loss: 0.0793 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0838 - val_loss: 0.0793 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0842 - val_loss: 0.0793 - lr: 1.3816e-12
Epoch 1/100
22/22 [==============================] - 5s 59ms/step - loss: 0.2354 - val_loss: 0.2071 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.2011 - val_loss: 0.1923 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 31ms/step - loss: 0.1839 - val_loss: 0.1753 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1696 - val_loss: 0.1620 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1589 - val_loss: 0.1553 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 30ms/step - loss: 0.1534 - val_loss: 0.1512 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1449 - val_loss: 0.1465 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1350 - val_loss: 0.1337 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1221 - val_loss: 0.1228 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1141 - val_loss: 0.1165 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1040 - val_loss: 0.1104 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0999 - val_loss: 0.1032 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0949 - val_loss: 0.0987 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0911 - val_loss: 0.0945 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0880 - val_loss: 0.0905 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0858 - val_loss: 0.0884 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0822 - val_loss: 0.0861 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0811 - val_loss: 0.0858 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0783 - val_loss: 0.0837 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0776 - val_loss: 0.0839 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0776 - val_loss: 0.0870 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0765 - val_loss: 0.0858 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0762 - val_loss: 0.0852 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0768 - val_loss: 0.0848 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0771 - val_loss: 0.0811 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0761 - val_loss: 0.0807 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0738 - val_loss: 0.0812 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0736 - val_loss: 0.0804 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0732 - val_loss: 0.0804 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0730 - val_loss: 0.0804 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0728 - val_loss: 0.0803 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0726 - val_loss: 0.0803 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0721 - val_loss: 0.0803 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0722 - val_loss: 0.0802 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0719 - val_loss: 0.0802 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0713 - val_loss: 0.0802 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0722 - val_loss: 0.0802 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0722 - val_loss: 0.0802 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0713 - val_loss: 0.0802 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0713 - val_loss: 0.0802 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0714 - val_loss: 0.0802 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0714 - val_loss: 0.0802 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 9.2853e-14
Average Validation Loss: 0.10979399234056472
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 64ms/step - loss: 0.1172 - val_loss: 0.1699 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1366 - val_loss: 0.1323 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1126 - val_loss: 0.1398 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1144 - val_loss: 0.1306 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1011 - val_loss: 0.1399 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 23ms/step - loss: 0.1066 - val_loss: 0.1221 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0814 - val_loss: 0.1158 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0737 - val_loss: 0.1090 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0688 - val_loss: 0.1035 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0785 - val_loss: 0.0964 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0583 - val_loss: 0.0953 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0571 - val_loss: 0.1250 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0599 - val_loss: 0.1091 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0522 - val_loss: 0.0921 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0524 - val_loss: 0.0916 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0472 - val_loss: 0.0951 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0477 - val_loss: 0.1102 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0484 - val_loss: 0.1102 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0469 - val_loss: 0.1001 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0454 - val_loss: 0.0955 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0435 - val_loss: 0.0995 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0433 - val_loss: 0.0920 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0430 - val_loss: 0.1000 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0429 - val_loss: 0.0923 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0415 - val_loss: 0.0982 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0423 - val_loss: 0.0937 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0412 - val_loss: 0.0939 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0414 - val_loss: 0.0931 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0414 - val_loss: 0.0934 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0410 - val_loss: 0.0967 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0423 - val_loss: 0.0967 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0426 - val_loss: 0.0965 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0405 - val_loss: 0.0959 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0401 - val_loss: 0.0957 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0401 - val_loss: 0.0953 - lr: 1.1109e-05
Epoch 1/100
34/34 [==============================] - 4s 34ms/step - loss: 0.1408 - val_loss: 0.1065 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1363 - val_loss: 0.0758 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1262 - val_loss: 0.0920 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1227 - val_loss: 0.0720 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1200 - val_loss: 0.0905 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1175 - val_loss: 0.0701 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1128 - val_loss: 0.0913 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1119 - val_loss: 0.0709 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1050 - val_loss: 0.0886 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1037 - val_loss: 0.0698 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0975 - val_loss: 0.0941 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0904 - val_loss: 0.0836 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0891 - val_loss: 0.0744 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0870 - val_loss: 0.0734 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0788 - val_loss: 0.0679 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0726 - val_loss: 0.0648 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0676 - val_loss: 0.0615 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0643 - val_loss: 0.0601 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0636 - val_loss: 0.0579 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0597 - val_loss: 0.0585 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0576 - val_loss: 0.0595 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0552 - val_loss: 0.0600 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0541 - val_loss: 0.0603 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0525 - val_loss: 0.0606 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0503 - val_loss: 0.0631 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0503 - val_loss: 0.0623 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0483 - val_loss: 0.0637 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0637 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0491 - val_loss: 0.0645 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0482 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0469 - val_loss: 0.0653 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0481 - val_loss: 0.0657 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0483 - val_loss: 0.0653 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0475 - val_loss: 0.0649 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0480 - val_loss: 0.0651 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0476 - val_loss: 0.0651 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0471 - val_loss: 0.0653 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0467 - val_loss: 0.0654 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0476 - val_loss: 0.0655 - lr: 3.3460e-06
Epoch 1/100
51/51 [==============================] - 5s 41ms/step - loss: 0.1381 - val_loss: 0.1209 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1225 - val_loss: 0.1160 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1150 - val_loss: 0.1100 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1114 - val_loss: 0.1058 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 23ms/step - loss: 0.1077 - val_loss: 0.1017 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 22ms/step - loss: 0.1054 - val_loss: 0.0988 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1032 - val_loss: 0.0986 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1022 - val_loss: 0.0959 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0991 - val_loss: 0.0959 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0986 - val_loss: 0.0942 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0916 - val_loss: 0.0875 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0896 - val_loss: 0.0883 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0827 - val_loss: 0.0796 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0765 - val_loss: 0.0745 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0731 - val_loss: 0.0656 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0647 - val_loss: 0.0618 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0614 - val_loss: 0.0623 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0569 - val_loss: 0.0572 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0529 - val_loss: 0.0566 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0520 - val_loss: 0.0557 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0504 - val_loss: 0.0540 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0549 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0513 - val_loss: 0.0532 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0515 - val_loss: 0.0523 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0544 - val_loss: 0.0509 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0520 - val_loss: 0.0520 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0511 - val_loss: 0.0543 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0490 - val_loss: 0.0547 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0486 - val_loss: 0.0553 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0487 - val_loss: 0.0561 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0470 - val_loss: 0.0562 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0463 - val_loss: 0.0556 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0556 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0454 - val_loss: 0.0557 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0453 - val_loss: 0.0555 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0453 - val_loss: 0.0554 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0453 - val_loss: 0.0553 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0456 - val_loss: 0.0553 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0450 - val_loss: 0.0553 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0453 - val_loss: 0.0553 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0554 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0452 - val_loss: 0.0553 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0446 - val_loss: 0.0554 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0452 - val_loss: 0.0554 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0554 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 5s 30ms/step - loss: 0.1296 - val_loss: 0.1332 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1199 - val_loss: 0.1222 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1120 - val_loss: 0.1143 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1074 - val_loss: 0.1022 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1003 - val_loss: 0.0961 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0966 - val_loss: 0.0915 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0887 - val_loss: 0.0901 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0824 - val_loss: 0.1012 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0787 - val_loss: 0.0903 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0712 - val_loss: 0.1203 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0701 - val_loss: 0.1121 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0657 - val_loss: 0.0904 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0624 - val_loss: 0.0867 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0608 - val_loss: 0.0731 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0598 - val_loss: 0.0688 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0590 - val_loss: 0.0658 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0565 - val_loss: 0.0657 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0538 - val_loss: 0.0634 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0521 - val_loss: 0.0620 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0512 - val_loss: 0.0629 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0501 - val_loss: 0.0618 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0495 - val_loss: 0.0631 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0488 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0483 - val_loss: 0.0646 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0481 - val_loss: 0.0622 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0489 - val_loss: 0.0617 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0601 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0494 - val_loss: 0.0557 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0478 - val_loss: 0.0541 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0470 - val_loss: 0.0529 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0461 - val_loss: 0.0525 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0462 - val_loss: 0.0516 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0453 - val_loss: 0.0513 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0452 - val_loss: 0.0511 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0450 - val_loss: 0.0510 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0510 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0445 - val_loss: 0.0509 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0451 - val_loss: 0.0509 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0442 - val_loss: 0.0508 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0447 - val_loss: 0.0507 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0430 - val_loss: 0.0507 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0452 - val_loss: 0.0507 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0448 - val_loss: 0.0507 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0507 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0437 - val_loss: 0.0507 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0444 - val_loss: 0.0507 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0447 - val_loss: 0.0507 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0507 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0438 - val_loss: 0.0507 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0447 - val_loss: 0.0507 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0442 - val_loss: 0.0507 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0436 - val_loss: 0.0507 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0450 - val_loss: 0.0507 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0448 - val_loss: 0.0507 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0442 - val_loss: 0.0507 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0507 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0507 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0437 - val_loss: 0.0507 - lr: 3.1068e-16
Epoch 1/100
85/85 [==============================] - 5s 30ms/step - loss: 0.1315 - val_loss: 0.1098 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1141 - val_loss: 0.1032 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1045 - val_loss: 0.0986 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0995 - val_loss: 0.0967 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0907 - val_loss: 0.0926 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0835 - val_loss: 0.0898 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0764 - val_loss: 0.0892 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0756 - val_loss: 0.0897 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0726 - val_loss: 0.0827 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0667 - val_loss: 0.0811 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0605 - val_loss: 0.0780 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0590 - val_loss: 0.0757 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0567 - val_loss: 0.0730 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0545 - val_loss: 0.0725 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0532 - val_loss: 0.0702 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0510 - val_loss: 0.0695 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0494 - val_loss: 0.0688 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0481 - val_loss: 0.0672 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0479 - val_loss: 0.0662 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0467 - val_loss: 0.0657 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0442 - val_loss: 0.0637 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0437 - val_loss: 0.0628 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0417 - val_loss: 0.0609 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0404 - val_loss: 0.0598 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0402 - val_loss: 0.0597 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0388 - val_loss: 0.0591 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0394 - val_loss: 0.0588 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0376 - val_loss: 0.0581 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0381 - val_loss: 0.0586 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0381 - val_loss: 0.0582 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0384 - val_loss: 0.0572 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0376 - val_loss: 0.0565 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0376 - val_loss: 0.0560 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0372 - val_loss: 0.0558 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0371 - val_loss: 0.0557 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0557 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0556 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0359 - val_loss: 0.0555 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0367 - val_loss: 0.0555 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0373 - val_loss: 0.0555 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0362 - val_loss: 0.0555 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0361 - val_loss: 0.0555 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0370 - val_loss: 0.0555 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0367 - val_loss: 0.0555 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0359 - val_loss: 0.0555 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0367 - val_loss: 0.0555 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0361 - val_loss: 0.0555 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 1.3924e-15
Average Validation Loss: 0.0613083653151989
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 121ms/step - loss: 0.1389 - val_loss: 0.1652 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1375 - val_loss: 0.1708 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1294 - val_loss: 0.1447 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1195 - val_loss: 0.1339 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1098 - val_loss: 0.1351 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1048 - val_loss: 0.1385 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1028 - val_loss: 0.1310 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0997 - val_loss: 0.1223 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.1202 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0753 - val_loss: 0.1114 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0686 - val_loss: 0.1016 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0614 - val_loss: 0.1054 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0525 - val_loss: 0.1223 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0568 - val_loss: 0.1046 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0508 - val_loss: 0.1031 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0493 - val_loss: 0.1073 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0497 - val_loss: 0.1068 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0477 - val_loss: 0.1001 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0470 - val_loss: 0.1040 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0490 - val_loss: 0.1118 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0483 - val_loss: 0.0989 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0464 - val_loss: 0.1108 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0480 - val_loss: 0.0977 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0464 - val_loss: 0.1042 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0472 - val_loss: 0.0996 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0449 - val_loss: 0.1004 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0451 - val_loss: 0.1030 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0452 - val_loss: 0.1019 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0452 - val_loss: 0.1021 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0458 - val_loss: 0.1021 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0445 - val_loss: 0.1026 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0445 - val_loss: 0.1025 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0445 - val_loss: 0.1019 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 1s 127ms/step - loss: 0.0462 - val_loss: 0.1019 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0446 - val_loss: 0.1019 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0449 - val_loss: 0.1021 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0437 - val_loss: 0.1023 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0450 - val_loss: 0.1024 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0453 - val_loss: 0.1023 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0459 - val_loss: 0.1022 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0462 - val_loss: 0.1022 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0443 - val_loss: 0.1022 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0445 - val_loss: 0.1022 - lr: 7.4659e-07
Epoch 1/100
17/17 [==============================] - 3s 71ms/step - loss: 0.1655 - val_loss: 0.0875 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1336 - val_loss: 0.0909 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1248 - val_loss: 0.0846 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1205 - val_loss: 0.0826 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1163 - val_loss: 0.0834 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1116 - val_loss: 0.0852 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1088 - val_loss: 0.0856 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1051 - val_loss: 0.0765 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1003 - val_loss: 0.0796 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0901 - val_loss: 0.0941 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0931 - val_loss: 0.0739 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0858 - val_loss: 0.0741 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0750 - val_loss: 0.0781 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0722 - val_loss: 0.0748 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0678 - val_loss: 0.0753 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0641 - val_loss: 0.0740 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0611 - val_loss: 0.0740 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0602 - val_loss: 0.0716 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0592 - val_loss: 0.0715 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0573 - val_loss: 0.0748 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0573 - val_loss: 0.0713 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0564 - val_loss: 0.0704 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0546 - val_loss: 0.0714 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0533 - val_loss: 0.0707 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0539 - val_loss: 0.0703 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0545 - val_loss: 0.0721 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0525 - val_loss: 0.0705 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0522 - val_loss: 0.0710 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0532 - val_loss: 0.0708 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0535 - val_loss: 0.0718 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0718 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0531 - val_loss: 0.0721 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0518 - val_loss: 0.0723 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0519 - val_loss: 0.0719 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0528 - val_loss: 0.0715 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0524 - val_loss: 0.0715 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0527 - val_loss: 0.0716 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0522 - val_loss: 0.0715 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0531 - val_loss: 0.0716 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0522 - val_loss: 0.0717 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0531 - val_loss: 0.0717 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0535 - val_loss: 0.0717 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0526 - val_loss: 0.0716 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0525 - val_loss: 0.0716 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0524 - val_loss: 0.0716 - lr: 3.3546e-07
Epoch 1/100
26/26 [==============================] - 4s 49ms/step - loss: 0.1401 - val_loss: 0.1264 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1169 - val_loss: 0.1127 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1083 - val_loss: 0.1027 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1033 - val_loss: 0.0893 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1001 - val_loss: 0.0842 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0964 - val_loss: 0.0813 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0913 - val_loss: 0.0805 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0863 - val_loss: 0.0762 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0816 - val_loss: 0.0708 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0770 - val_loss: 0.0673 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0587 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0692 - val_loss: 0.0634 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0705 - val_loss: 0.0645 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0752 - val_loss: 0.0617 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0747 - val_loss: 0.0590 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0798 - val_loss: 0.0723 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0695 - val_loss: 0.0652 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0626 - val_loss: 0.0559 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0625 - val_loss: 0.0560 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0610 - val_loss: 0.0563 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0565 - val_loss: 0.0544 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0568 - val_loss: 0.0562 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0575 - val_loss: 0.0632 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0532 - val_loss: 0.0597 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0528 - val_loss: 0.0581 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0523 - val_loss: 0.0583 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0571 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0515 - val_loss: 0.0576 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0511 - val_loss: 0.0579 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0493 - val_loss: 0.0565 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0571 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0497 - val_loss: 0.0574 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0500 - val_loss: 0.0573 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0501 - val_loss: 0.0574 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0494 - val_loss: 0.0573 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0493 - val_loss: 0.0573 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0499 - val_loss: 0.0575 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0498 - val_loss: 0.0575 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0488 - val_loss: 0.0576 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0490 - val_loss: 0.0575 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0491 - val_loss: 0.0575 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1409 - val_loss: 0.1127 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1124 - val_loss: 0.1186 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1063 - val_loss: 0.1131 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0963 - val_loss: 0.1014 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0899 - val_loss: 0.0786 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0794 - val_loss: 0.0775 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0722 - val_loss: 0.0738 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0653 - val_loss: 0.0907 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0657 - val_loss: 0.0882 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0715 - val_loss: 0.0685 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0631 - val_loss: 0.0713 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0641 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0573 - val_loss: 0.0634 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0564 - val_loss: 0.0688 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0547 - val_loss: 0.0639 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0533 - val_loss: 0.0606 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0687 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0691 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0526 - val_loss: 0.0759 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0528 - val_loss: 0.0702 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0525 - val_loss: 0.0872 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0627 - val_loss: 0.0851 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0680 - val_loss: 0.0609 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0589 - val_loss: 0.0515 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0552 - val_loss: 0.0478 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0529 - val_loss: 0.0468 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0516 - val_loss: 0.0455 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0507 - val_loss: 0.0443 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0503 - val_loss: 0.0440 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0488 - val_loss: 0.0435 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0483 - val_loss: 0.0433 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0477 - val_loss: 0.0432 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0471 - val_loss: 0.0432 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0474 - val_loss: 0.0430 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0478 - val_loss: 0.0430 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0471 - val_loss: 0.0429 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0429 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0429 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0429 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0470 - val_loss: 0.0429 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0465 - val_loss: 0.0429 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0472 - val_loss: 0.0429 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0462 - val_loss: 0.0429 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0469 - val_loss: 0.0429 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0473 - val_loss: 0.0429 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0462 - val_loss: 0.0429 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0469 - val_loss: 0.0429 - lr: 3.0590e-10
Epoch 1/100
43/43 [==============================] - 5s 37ms/step - loss: 0.1261 - val_loss: 0.1122 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1052 - val_loss: 0.1049 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0965 - val_loss: 0.1008 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0873 - val_loss: 0.0964 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0830 - val_loss: 0.0940 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0797 - val_loss: 0.0917 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0758 - val_loss: 0.0891 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0720 - val_loss: 0.0863 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0711 - val_loss: 0.0848 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0670 - val_loss: 0.0880 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0664 - val_loss: 0.0888 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0690 - val_loss: 0.0836 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0862 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0609 - val_loss: 0.0792 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0569 - val_loss: 0.0745 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0532 - val_loss: 0.0728 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0506 - val_loss: 0.0705 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0501 - val_loss: 0.0692 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0480 - val_loss: 0.0682 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0462 - val_loss: 0.0662 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0457 - val_loss: 0.0655 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0458 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0647 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0443 - val_loss: 0.0640 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0433 - val_loss: 0.0633 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0436 - val_loss: 0.0627 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0429 - val_loss: 0.0620 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0428 - val_loss: 0.0616 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0434 - val_loss: 0.0610 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0424 - val_loss: 0.0602 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0425 - val_loss: 0.0596 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0416 - val_loss: 0.0593 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0409 - val_loss: 0.0590 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0589 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0409 - val_loss: 0.0588 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0405 - val_loss: 0.0587 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0410 - val_loss: 0.0587 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0403 - val_loss: 0.0586 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0407 - val_loss: 0.0586 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0402 - val_loss: 0.0585 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0400 - val_loss: 0.0585 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0398 - val_loss: 0.0585 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0585 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0402 - val_loss: 0.0585 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0401 - val_loss: 0.0585 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0401 - val_loss: 0.0585 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0585 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0407 - val_loss: 0.0585 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0401 - val_loss: 0.0585 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0400 - val_loss: 0.0585 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0407 - val_loss: 0.0585 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 2.8039e-15
Epoch 79/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 1.3924e-15
Epoch 80/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0585 - lr: 6.9144e-16
Epoch 81/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 3.1068e-16
Epoch 82/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 1.3960e-16
Epoch 83/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 6.2726e-17
Average Validation Loss: 0.064755929261446
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 207ms/step - loss: 0.2585 - val_loss: 0.1727 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 73ms/step - loss: 0.1255 - val_loss: 0.1481 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 66ms/step - loss: 0.1211 - val_loss: 0.1641 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 61ms/step - loss: 0.1293 - val_loss: 0.1663 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1317 - val_loss: 0.1571 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1226 - val_loss: 0.1418 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1155 - val_loss: 0.1295 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1115 - val_loss: 0.1244 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1058 - val_loss: 0.1235 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1029 - val_loss: 0.1248 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0989 - val_loss: 0.1238 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0918 - val_loss: 0.1165 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0843 - val_loss: 0.1074 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0735 - val_loss: 0.1056 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0668 - val_loss: 0.1024 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0602 - val_loss: 0.0994 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0577 - val_loss: 0.1055 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0591 - val_loss: 0.0993 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0571 - val_loss: 0.1050 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0543 - val_loss: 0.1021 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0543 - val_loss: 0.1026 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0546 - val_loss: 0.1022 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0545 - val_loss: 0.1001 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0526 - val_loss: 0.1026 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0537 - val_loss: 0.1024 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0525 - val_loss: 0.1012 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0522 - val_loss: 0.1018 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0532 - val_loss: 0.1026 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0526 - val_loss: 0.1021 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0519 - val_loss: 0.1012 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0531 - val_loss: 0.1011 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0520 - val_loss: 0.1014 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0535 - val_loss: 0.1015 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0526 - val_loss: 0.1018 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0520 - val_loss: 0.1019 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0529 - val_loss: 0.1020 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0538 - val_loss: 0.1020 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0527 - val_loss: 0.1020 - lr: 4.5166e-06
Epoch 1/100
9/9 [==============================] - 4s 118ms/step - loss: 0.1392 - val_loss: 0.0910 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1260 - val_loss: 0.0967 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1190 - val_loss: 0.0900 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1112 - val_loss: 0.0759 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1044 - val_loss: 0.0947 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1006 - val_loss: 0.0799 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0944 - val_loss: 0.0864 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0881 - val_loss: 0.0872 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0851 - val_loss: 0.0809 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0809 - val_loss: 0.0879 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0770 - val_loss: 0.0796 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0724 - val_loss: 0.0806 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0714 - val_loss: 0.0745 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0676 - val_loss: 0.0713 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0672 - val_loss: 0.0662 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0656 - val_loss: 0.0703 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0635 - val_loss: 0.0742 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0644 - val_loss: 0.0633 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0614 - val_loss: 0.0667 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0590 - val_loss: 0.0656 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0585 - val_loss: 0.0647 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0576 - val_loss: 0.0627 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0572 - val_loss: 0.0631 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0561 - val_loss: 0.0633 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0555 - val_loss: 0.0611 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0568 - val_loss: 0.0644 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0545 - val_loss: 0.0624 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0549 - val_loss: 0.0625 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0552 - val_loss: 0.0634 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0542 - val_loss: 0.0625 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0559 - val_loss: 0.0631 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0563 - val_loss: 0.0634 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0543 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0535 - val_loss: 0.0632 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0554 - val_loss: 0.0630 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0547 - val_loss: 0.0628 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0547 - val_loss: 0.0629 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0542 - val_loss: 0.0630 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0539 - val_loss: 0.0631 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0545 - val_loss: 0.0630 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0543 - val_loss: 0.0631 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0549 - val_loss: 0.0631 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0544 - val_loss: 0.0631 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0544 - val_loss: 0.0631 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0543 - val_loss: 0.0631 - lr: 3.3546e-07
Epoch 1/100
13/13 [==============================] - 4s 87ms/step - loss: 0.1474 - val_loss: 0.1286 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1218 - val_loss: 0.1328 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1131 - val_loss: 0.1178 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1059 - val_loss: 0.1071 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1038 - val_loss: 0.0962 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0987 - val_loss: 0.0923 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0952 - val_loss: 0.0842 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0928 - val_loss: 0.0784 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0882 - val_loss: 0.0742 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0871 - val_loss: 0.0728 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0816 - val_loss: 0.0709 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0785 - val_loss: 0.0691 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0733 - val_loss: 0.0664 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0700 - val_loss: 0.0637 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0675 - val_loss: 0.0624 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0673 - val_loss: 0.0609 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0701 - val_loss: 0.0624 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0659 - val_loss: 0.0632 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0613 - val_loss: 0.0596 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0608 - val_loss: 0.0577 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0593 - val_loss: 0.0572 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0580 - val_loss: 0.0560 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0573 - val_loss: 0.0571 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0570 - val_loss: 0.0563 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0562 - val_loss: 0.0553 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0560 - val_loss: 0.0560 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0557 - val_loss: 0.0556 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0554 - val_loss: 0.0548 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0550 - val_loss: 0.0551 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0543 - val_loss: 0.0552 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0546 - val_loss: 0.0551 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0548 - val_loss: 0.0552 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0542 - val_loss: 0.0548 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0545 - val_loss: 0.0547 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0543 - val_loss: 0.0549 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0541 - val_loss: 0.0548 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0551 - val_loss: 0.0549 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0543 - val_loss: 0.0550 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0544 - val_loss: 0.0550 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0536 - val_loss: 0.0550 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0540 - val_loss: 0.0549 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0549 - val_loss: 0.0549 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0538 - val_loss: 0.0549 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0539 - val_loss: 0.0549 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0545 - val_loss: 0.0549 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0534 - val_loss: 0.0549 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0541 - val_loss: 0.0549 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0543 - val_loss: 0.0549 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0546 - val_loss: 0.0549 - lr: 6.1442e-09
Epoch 1/100
17/17 [==============================] - 4s 76ms/step - loss: 0.1360 - val_loss: 0.1268 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 35ms/step - loss: 0.1200 - val_loss: 0.1163 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1073 - val_loss: 0.1168 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1025 - val_loss: 0.1239 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1049 - val_loss: 0.1237 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1021 - val_loss: 0.0992 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0872 - val_loss: 0.1102 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0895 - val_loss: 0.1329 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1012 - val_loss: 0.0973 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0870 - val_loss: 0.0887 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0758 - val_loss: 0.1019 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0774 - val_loss: 0.1096 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0850 - val_loss: 0.0928 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0782 - val_loss: 0.0763 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0652 - val_loss: 0.0820 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0663 - val_loss: 0.0815 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0657 - val_loss: 0.0789 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0657 - val_loss: 0.0706 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0621 - val_loss: 0.0667 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0586 - val_loss: 0.0647 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0573 - val_loss: 0.0622 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0551 - val_loss: 0.0606 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0550 - val_loss: 0.0583 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0529 - val_loss: 0.0575 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0528 - val_loss: 0.0572 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0519 - val_loss: 0.0562 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0518 - val_loss: 0.0555 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0521 - val_loss: 0.0551 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0507 - val_loss: 0.0549 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0517 - val_loss: 0.0545 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0507 - val_loss: 0.0544 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0503 - val_loss: 0.0542 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0512 - val_loss: 0.0541 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0507 - val_loss: 0.0540 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0508 - val_loss: 0.0540 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0504 - val_loss: 0.0540 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0507 - val_loss: 0.0540 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0540 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0505 - val_loss: 0.0540 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0499 - val_loss: 0.0539 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0512 - val_loss: 0.0539 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0507 - val_loss: 0.0539 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0502 - val_loss: 0.0539 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0502 - val_loss: 0.0539 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0501 - val_loss: 0.0539 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0509 - val_loss: 0.0539 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0512 - val_loss: 0.0539 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0514 - val_loss: 0.0539 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0501 - val_loss: 0.0539 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0508 - val_loss: 0.0539 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0507 - val_loss: 0.0539 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0501 - val_loss: 0.0539 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0500 - val_loss: 0.0539 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0507 - val_loss: 0.0539 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0504 - val_loss: 0.0539 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0500 - val_loss: 0.0539 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0504 - val_loss: 0.0539 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0514 - val_loss: 0.0539 - lr: 1.1370e-14
Epoch 77/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0510 - val_loss: 0.0539 - lr: 5.6464e-15
Epoch 78/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0502 - val_loss: 0.0539 - lr: 2.8039e-15
Epoch 79/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0509 - val_loss: 0.0539 - lr: 1.3924e-15
Epoch 1/100
22/22 [==============================] - 4s 60ms/step - loss: 0.1322 - val_loss: 0.1169 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1169 - val_loss: 0.1109 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1101 - val_loss: 0.1071 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1079 - val_loss: 0.1074 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1033 - val_loss: 0.1039 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0963 - val_loss: 0.0969 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0907 - val_loss: 0.0939 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0850 - val_loss: 0.0884 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0807 - val_loss: 0.0898 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0780 - val_loss: 0.0827 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0706 - val_loss: 0.0789 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0669 - val_loss: 0.0773 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0644 - val_loss: 0.0747 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0618 - val_loss: 0.0732 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0603 - val_loss: 0.0724 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0593 - val_loss: 0.0722 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0585 - val_loss: 0.0759 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0603 - val_loss: 0.0823 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0642 - val_loss: 0.0850 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0649 - val_loss: 0.0798 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0602 - val_loss: 0.0713 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0548 - val_loss: 0.0683 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0666 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0650 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0495 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0489 - val_loss: 0.0636 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0487 - val_loss: 0.0633 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0480 - val_loss: 0.0628 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0480 - val_loss: 0.0626 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0626 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0478 - val_loss: 0.0623 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0471 - val_loss: 0.0623 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0481 - val_loss: 0.0621 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0475 - val_loss: 0.0620 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0474 - val_loss: 0.0620 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0467 - val_loss: 0.0619 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0619 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0470 - val_loss: 0.0619 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0471 - val_loss: 0.0619 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0476 - val_loss: 0.0619 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0473 - val_loss: 0.0619 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0465 - val_loss: 0.0619 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0475 - val_loss: 0.0619 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0471 - val_loss: 0.0619 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0470 - val_loss: 0.0619 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0465 - val_loss: 0.0619 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 2.2897e-14
Average Validation Loss: 0.06619365066289902
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 68ms/step - loss: 0.1037 - val_loss: 0.1579 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1240 - val_loss: 0.1221 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1028 - val_loss: 0.1227 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0981 - val_loss: 0.1201 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0940 - val_loss: 0.1236 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0975 - val_loss: 0.1139 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0833 - val_loss: 0.1184 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0737 - val_loss: 0.1333 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0722 - val_loss: 0.1314 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0784 - val_loss: 0.1049 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0666 - val_loss: 0.0989 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0647 - val_loss: 0.0960 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0533 - val_loss: 0.1027 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0491 - val_loss: 0.0920 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0447 - val_loss: 0.0960 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0425 - val_loss: 0.0995 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0408 - val_loss: 0.0930 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.1025 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0401 - val_loss: 0.1003 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0407 - val_loss: 0.0861 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0389 - val_loss: 0.0927 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.0963 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0380 - val_loss: 0.0954 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0375 - val_loss: 0.0964 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0371 - val_loss: 0.0930 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0361 - val_loss: 0.0924 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0375 - val_loss: 0.0909 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0363 - val_loss: 0.0943 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0350 - val_loss: 0.0952 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0362 - val_loss: 0.0910 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0354 - val_loss: 0.0913 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0353 - val_loss: 0.0939 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0354 - val_loss: 0.0954 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0373 - val_loss: 0.0959 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0363 - val_loss: 0.0955 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0374 - val_loss: 0.0944 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0358 - val_loss: 0.0938 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0359 - val_loss: 0.0940 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0368 - val_loss: 0.0938 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0359 - val_loss: 0.0937 - lr: 2.4788e-06
Epoch 1/100
34/34 [==============================] - 3s 34ms/step - loss: 0.1378 - val_loss: 0.0763 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1289 - val_loss: 0.0734 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1228 - val_loss: 0.0755 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1167 - val_loss: 0.0668 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1152 - val_loss: 0.0773 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1131 - val_loss: 0.0650 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1077 - val_loss: 0.0826 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1080 - val_loss: 0.0622 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1047 - val_loss: 0.0878 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1036 - val_loss: 0.0628 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0994 - val_loss: 0.0851 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0880 - val_loss: 0.0968 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0863 - val_loss: 0.0809 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0827 - val_loss: 0.0795 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0777 - val_loss: 0.0812 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0720 - val_loss: 0.0837 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0676 - val_loss: 0.0855 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0644 - val_loss: 0.0779 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0607 - val_loss: 0.0683 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0598 - val_loss: 0.0633 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0565 - val_loss: 0.0571 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0552 - val_loss: 0.0688 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0714 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0488 - val_loss: 0.0755 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0471 - val_loss: 0.0708 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0478 - val_loss: 0.0747 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0477 - val_loss: 0.0765 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0456 - val_loss: 0.0729 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0454 - val_loss: 0.0738 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0452 - val_loss: 0.0740 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0435 - val_loss: 0.0754 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0752 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0435 - val_loss: 0.0749 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0454 - val_loss: 0.0744 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0435 - val_loss: 0.0746 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0432 - val_loss: 0.0751 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0448 - val_loss: 0.0753 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0443 - val_loss: 0.0754 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0445 - val_loss: 0.0752 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0446 - val_loss: 0.0751 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0429 - val_loss: 0.0751 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 5s 39ms/step - loss: 0.1186 - val_loss: 0.1113 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1103 - val_loss: 0.1039 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1062 - val_loss: 0.0947 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1025 - val_loss: 0.0943 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0973 - val_loss: 0.0872 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0971 - val_loss: 0.0904 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0943 - val_loss: 0.0845 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0897 - val_loss: 0.0852 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0875 - val_loss: 0.0788 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0838 - val_loss: 0.0762 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0766 - val_loss: 0.0682 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0691 - val_loss: 0.0598 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0696 - val_loss: 0.0592 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0599 - val_loss: 0.0525 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0581 - val_loss: 0.0556 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0529 - val_loss: 0.0477 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0510 - val_loss: 0.0532 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0509 - val_loss: 0.0467 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0490 - val_loss: 0.0512 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0494 - val_loss: 0.0469 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0472 - val_loss: 0.0476 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0497 - val_loss: 0.0475 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0499 - val_loss: 0.0449 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0490 - val_loss: 0.0434 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0489 - val_loss: 0.0448 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0462 - val_loss: 0.0457 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0452 - val_loss: 0.0456 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0463 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0437 - val_loss: 0.0467 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0432 - val_loss: 0.0469 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0419 - val_loss: 0.0473 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0417 - val_loss: 0.0472 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0419 - val_loss: 0.0473 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0472 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0417 - val_loss: 0.0472 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0415 - val_loss: 0.0473 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0408 - val_loss: 0.0475 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0412 - val_loss: 0.0475 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0409 - val_loss: 0.0474 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0412 - val_loss: 0.0474 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0410 - val_loss: 0.0474 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0410 - val_loss: 0.0474 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0410 - val_loss: 0.0473 - lr: 5.0045e-07
Epoch 1/100
68/68 [==============================] - 5s 37ms/step - loss: 0.1181 - val_loss: 0.1171 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1095 - val_loss: 0.1095 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1043 - val_loss: 0.1026 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0991 - val_loss: 0.0968 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0951 - val_loss: 0.0951 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0863 - val_loss: 0.0906 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0810 - val_loss: 0.0910 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0743 - val_loss: 0.0909 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0726 - val_loss: 0.0896 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0695 - val_loss: 0.0852 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0659 - val_loss: 0.0776 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0757 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0604 - val_loss: 0.0716 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0598 - val_loss: 0.0673 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0553 - val_loss: 0.0654 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0538 - val_loss: 0.0654 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0642 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0512 - val_loss: 0.0635 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0505 - val_loss: 0.0699 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0506 - val_loss: 0.0651 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0488 - val_loss: 0.0658 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0479 - val_loss: 0.0642 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0477 - val_loss: 0.0623 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0625 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0467 - val_loss: 0.0625 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0483 - val_loss: 0.0589 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0466 - val_loss: 0.0562 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0473 - val_loss: 0.0525 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0465 - val_loss: 0.0512 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0450 - val_loss: 0.0496 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0487 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0429 - val_loss: 0.0484 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0440 - val_loss: 0.0481 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0429 - val_loss: 0.0479 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0478 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0428 - val_loss: 0.0476 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0426 - val_loss: 0.0476 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0475 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0419 - val_loss: 0.0475 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0425 - val_loss: 0.0474 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0416 - val_loss: 0.0474 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0425 - val_loss: 0.0474 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0417 - val_loss: 0.0474 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0413 - val_loss: 0.0474 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0413 - val_loss: 0.0474 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0424 - val_loss: 0.0474 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0417 - val_loss: 0.0474 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0474 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0412 - val_loss: 0.0474 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0474 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0416 - val_loss: 0.0474 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0421 - val_loss: 0.0474 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0424 - val_loss: 0.0474 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0424 - val_loss: 0.0474 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0421 - val_loss: 0.0474 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0414 - val_loss: 0.0474 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0418 - val_loss: 0.0474 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0417 - val_loss: 0.0474 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0421 - val_loss: 0.0474 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 6.9144e-16
Epoch 1/100
85/85 [==============================] - 6s 31ms/step - loss: 0.1176 - val_loss: 0.1017 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 18ms/step - loss: 0.1039 - val_loss: 0.0966 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0944 - val_loss: 0.0930 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0874 - val_loss: 0.0892 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0834 - val_loss: 0.0878 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0780 - val_loss: 0.0834 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0727 - val_loss: 0.0831 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0717 - val_loss: 0.0837 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0725 - val_loss: 0.0770 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0624 - val_loss: 0.0717 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0578 - val_loss: 0.0690 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0541 - val_loss: 0.0653 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0525 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0539 - val_loss: 0.0639 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0488 - val_loss: 0.0627 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0463 - val_loss: 0.0615 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0471 - val_loss: 0.0619 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0465 - val_loss: 0.0591 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0436 - val_loss: 0.0589 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0421 - val_loss: 0.0585 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0420 - val_loss: 0.0576 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0399 - val_loss: 0.0568 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0381 - val_loss: 0.0556 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0371 - val_loss: 0.0555 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0362 - val_loss: 0.0548 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0358 - val_loss: 0.0543 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0350 - val_loss: 0.0544 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0354 - val_loss: 0.0546 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0357 - val_loss: 0.0541 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0355 - val_loss: 0.0540 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0359 - val_loss: 0.0536 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0357 - val_loss: 0.0533 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0353 - val_loss: 0.0531 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0356 - val_loss: 0.0529 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0350 - val_loss: 0.0528 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0344 - val_loss: 0.0527 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0344 - val_loss: 0.0527 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0342 - val_loss: 0.0526 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0342 - val_loss: 0.0526 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 3s 33ms/step - loss: 0.0348 - val_loss: 0.0526 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 3s 34ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 3s 39ms/step - loss: 0.0342 - val_loss: 0.0526 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 3s 36ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 3s 37ms/step - loss: 0.0338 - val_loss: 0.0526 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 3s 31ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0346 - val_loss: 0.0526 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 3s 35ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0346 - val_loss: 0.0526 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0333 - val_loss: 0.0526 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0339 - val_loss: 0.0526 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0339 - val_loss: 0.0526 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0343 - val_loss: 0.0526 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0343 - val_loss: 0.0526 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 5.6464e-15
Average Validation Loss: 0.057302170991897584
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 122ms/step - loss: 0.1117 - val_loss: 0.1679 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1274 - val_loss: 0.1533 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1156 - val_loss: 0.1210 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0993 - val_loss: 0.1176 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0889 - val_loss: 0.1249 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0858 - val_loss: 0.1200 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0861 - val_loss: 0.1103 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0752 - val_loss: 0.1072 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0639 - val_loss: 0.1001 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0560 - val_loss: 0.0886 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0552 - val_loss: 0.0883 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0480 - val_loss: 0.1116 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0539 - val_loss: 0.1025 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0483 - val_loss: 0.0897 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0440 - val_loss: 0.1056 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0464 - val_loss: 0.0878 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0419 - val_loss: 0.0972 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0415 - val_loss: 0.0964 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0418 - val_loss: 0.0949 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0399 - val_loss: 0.0956 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0407 - val_loss: 0.0919 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0403 - val_loss: 0.0963 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0393 - val_loss: 0.0910 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0375 - val_loss: 0.0949 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0378 - val_loss: 0.0951 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0394 - val_loss: 0.0933 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0387 - val_loss: 0.0927 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0388 - val_loss: 0.0909 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0385 - val_loss: 0.0934 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0389 - val_loss: 0.0948 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0392 - val_loss: 0.0927 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0389 - val_loss: 0.0917 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0393 - val_loss: 0.0922 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0385 - val_loss: 0.0925 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0387 - val_loss: 0.0921 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0379 - val_loss: 0.0919 - lr: 8.2297e-06
Epoch 1/100
17/17 [==============================] - 4s 65ms/step - loss: 0.1403 - val_loss: 0.0739 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1216 - val_loss: 0.0819 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1104 - val_loss: 0.0735 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1043 - val_loss: 0.0735 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1030 - val_loss: 0.0714 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0976 - val_loss: 0.0718 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0891 - val_loss: 0.0795 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0918 - val_loss: 0.0753 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0885 - val_loss: 0.0753 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0793 - val_loss: 0.0824 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0771 - val_loss: 0.0762 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0738 - val_loss: 0.0722 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0680 - val_loss: 0.0658 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0635 - val_loss: 0.0645 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0612 - val_loss: 0.0649 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0577 - val_loss: 0.0626 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0556 - val_loss: 0.0603 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0540 - val_loss: 0.0602 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0520 - val_loss: 0.0627 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0511 - val_loss: 0.0672 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0492 - val_loss: 0.0676 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0504 - val_loss: 0.0625 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0496 - val_loss: 0.0645 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0475 - val_loss: 0.0644 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0475 - val_loss: 0.0658 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0454 - val_loss: 0.0656 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0459 - val_loss: 0.0680 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0460 - val_loss: 0.0647 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0461 - val_loss: 0.0662 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0458 - val_loss: 0.0655 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0465 - val_loss: 0.0643 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0459 - val_loss: 0.0653 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0462 - val_loss: 0.0655 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0456 - val_loss: 0.0655 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0456 - val_loss: 0.0658 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0453 - val_loss: 0.0658 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0460 - val_loss: 0.0660 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0455 - val_loss: 0.0660 - lr: 4.5166e-06
Epoch 1/100
26/26 [==============================] - 6s 49ms/step - loss: 0.1290 - val_loss: 0.1201 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1117 - val_loss: 0.1126 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1018 - val_loss: 0.1033 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0993 - val_loss: 0.0946 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0940 - val_loss: 0.0870 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0893 - val_loss: 0.0849 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0849 - val_loss: 0.0830 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0795 - val_loss: 0.0748 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0761 - val_loss: 0.0782 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0732 - val_loss: 0.0649 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0687 - val_loss: 0.0739 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0697 - val_loss: 0.0710 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0667 - val_loss: 0.0729 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0720 - val_loss: 0.0623 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0635 - val_loss: 0.0619 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0647 - val_loss: 0.0586 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0601 - val_loss: 0.0572 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0570 - val_loss: 0.0560 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0529 - val_loss: 0.0550 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0524 - val_loss: 0.0538 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0519 - val_loss: 0.0524 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0526 - val_loss: 0.0519 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0532 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0485 - val_loss: 0.0518 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0475 - val_loss: 0.0515 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0509 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0452 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0458 - val_loss: 0.0506 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0449 - val_loss: 0.0505 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0502 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0502 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0444 - val_loss: 0.0501 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0438 - val_loss: 0.0499 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0499 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0449 - val_loss: 0.0499 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0499 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0498 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0450 - val_loss: 0.0498 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0440 - val_loss: 0.0498 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0447 - val_loss: 0.0498 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0455 - val_loss: 0.0498 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0442 - val_loss: 0.0498 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0435 - val_loss: 0.0498 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0498 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0439 - val_loss: 0.0498 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0434 - val_loss: 0.0498 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0448 - val_loss: 0.0498 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0442 - val_loss: 0.0498 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0438 - val_loss: 0.0498 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0434 - val_loss: 0.0498 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0451 - val_loss: 0.0498 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0439 - val_loss: 0.0498 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0436 - val_loss: 0.0498 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0445 - val_loss: 0.0498 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0446 - val_loss: 0.0498 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 5.0435e-10
Epoch 60/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 3.0590e-10
Epoch 61/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0449 - val_loss: 0.0498 - lr: 1.6788e-10
Epoch 62/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0445 - val_loss: 0.0498 - lr: 9.2136e-11
Epoch 63/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0448 - val_loss: 0.0498 - lr: 5.0565e-11
Epoch 64/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0445 - val_loss: 0.0498 - lr: 2.7751e-11
Epoch 1/100
34/34 [==============================] - 4s 48ms/step - loss: 0.1218 - val_loss: 0.1005 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0971 - val_loss: 0.1130 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0919 - val_loss: 0.0861 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0829 - val_loss: 0.0809 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0788 - val_loss: 0.0872 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0741 - val_loss: 0.0761 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0664 - val_loss: 0.0721 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0639 - val_loss: 0.0702 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0607 - val_loss: 0.0687 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0697 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0589 - val_loss: 0.0689 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0559 - val_loss: 0.0678 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0548 - val_loss: 0.0662 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0531 - val_loss: 0.0759 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0530 - val_loss: 0.0674 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0524 - val_loss: 0.0806 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0538 - val_loss: 0.0801 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0525 - val_loss: 0.0823 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0539 - val_loss: 0.0886 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0629 - val_loss: 0.0996 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0711 - val_loss: 0.0701 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0594 - val_loss: 0.0629 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0573 - val_loss: 0.0600 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0551 - val_loss: 0.0562 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0523 - val_loss: 0.0544 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0508 - val_loss: 0.0533 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0498 - val_loss: 0.0530 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0490 - val_loss: 0.0524 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0477 - val_loss: 0.0520 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0478 - val_loss: 0.0517 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0515 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0464 - val_loss: 0.0514 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0463 - val_loss: 0.0512 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0512 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0462 - val_loss: 0.0511 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0511 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0511 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0460 - val_loss: 0.0510 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0454 - val_loss: 0.0510 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0450 - val_loss: 0.0510 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0510 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0461 - val_loss: 0.0510 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0461 - val_loss: 0.0510 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0510 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0450 - val_loss: 0.0510 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0458 - val_loss: 0.0510 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0463 - val_loss: 0.0510 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0510 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0510 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0455 - val_loss: 0.0510 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0510 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0461 - val_loss: 0.0510 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0453 - val_loss: 0.0510 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0458 - val_loss: 0.0510 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0458 - val_loss: 0.0510 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0455 - val_loss: 0.0510 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0462 - val_loss: 0.0510 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0453 - val_loss: 0.0510 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0510 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0462 - val_loss: 0.0510 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 1.1370e-14
Epoch 1/100
43/43 [==============================] - 5s 39ms/step - loss: 0.1211 - val_loss: 0.1084 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 28ms/step - loss: 0.1021 - val_loss: 0.1047 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0896 - val_loss: 0.0992 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0843 - val_loss: 0.0946 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0796 - val_loss: 0.0929 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0741 - val_loss: 0.0899 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0668 - val_loss: 0.0861 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0596 - val_loss: 0.0841 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0867 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0660 - val_loss: 0.0841 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0809 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0598 - val_loss: 0.0851 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0633 - val_loss: 0.0789 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0572 - val_loss: 0.0779 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0533 - val_loss: 0.0766 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0488 - val_loss: 0.0761 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0479 - val_loss: 0.0759 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0478 - val_loss: 0.0731 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0448 - val_loss: 0.0713 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0438 - val_loss: 0.0699 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0431 - val_loss: 0.0689 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0414 - val_loss: 0.0691 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0397 - val_loss: 0.0684 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0403 - val_loss: 0.0682 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0410 - val_loss: 0.0677 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0410 - val_loss: 0.0674 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0423 - val_loss: 0.0674 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0423 - val_loss: 0.0663 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0422 - val_loss: 0.0650 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0408 - val_loss: 0.0644 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0399 - val_loss: 0.0640 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0392 - val_loss: 0.0638 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0389 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0381 - val_loss: 0.0636 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0387 - val_loss: 0.0635 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0386 - val_loss: 0.0634 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0381 - val_loss: 0.0634 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0387 - val_loss: 0.0634 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0386 - val_loss: 0.0634 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0385 - val_loss: 0.0633 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0384 - val_loss: 0.0633 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0373 - val_loss: 0.0633 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0376 - val_loss: 0.0633 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0385 - val_loss: 0.0633 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0383 - val_loss: 0.0633 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0385 - val_loss: 0.0633 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0376 - val_loss: 0.0633 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0383 - val_loss: 0.0633 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0374 - val_loss: 0.0633 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0377 - val_loss: 0.0633 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0377 - val_loss: 0.0633 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0384 - val_loss: 0.0633 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0383 - val_loss: 0.0633 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 1.1370e-14
Average Validation Loss: 0.06242504194378853
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 211ms/step - loss: 0.1598 - val_loss: 0.1249 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0981 - val_loss: 0.1422 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1106 - val_loss: 0.1536 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1144 - val_loss: 0.1479 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1095 - val_loss: 0.1350 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1052 - val_loss: 0.1245 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0993 - val_loss: 0.1195 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0955 - val_loss: 0.1187 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0904 - val_loss: 0.1203 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0881 - val_loss: 0.1213 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0822 - val_loss: 0.1202 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0786 - val_loss: 0.1115 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0707 - val_loss: 0.1037 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0606 - val_loss: 0.1030 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0574 - val_loss: 0.1001 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0525 - val_loss: 0.0970 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0509 - val_loss: 0.0963 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0472 - val_loss: 0.0967 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0451 - val_loss: 0.0943 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0451 - val_loss: 0.0993 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0440 - val_loss: 0.0954 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0433 - val_loss: 0.0938 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0433 - val_loss: 0.0969 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0429 - val_loss: 0.0953 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0428 - val_loss: 0.0923 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0428 - val_loss: 0.0950 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0431 - val_loss: 0.0964 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 51ms/step - loss: 0.0429 - val_loss: 0.0963 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 49ms/step - loss: 0.0428 - val_loss: 0.0953 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 57ms/step - loss: 0.0431 - val_loss: 0.0942 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 67ms/step - loss: 0.0430 - val_loss: 0.0936 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0421 - val_loss: 0.0938 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 63ms/step - loss: 0.0433 - val_loss: 0.0939 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 53ms/step - loss: 0.0421 - val_loss: 0.0938 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 66ms/step - loss: 0.0439 - val_loss: 0.0939 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 57ms/step - loss: 0.0417 - val_loss: 0.0941 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 92ms/step - loss: 0.0425 - val_loss: 0.0942 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 61ms/step - loss: 0.0419 - val_loss: 0.0942 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 69ms/step - loss: 0.0411 - val_loss: 0.0942 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 55ms/step - loss: 0.0406 - val_loss: 0.0941 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0427 - val_loss: 0.0941 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 51ms/step - loss: 0.0411 - val_loss: 0.0941 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 52ms/step - loss: 0.0411 - val_loss: 0.0942 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0417 - val_loss: 0.0942 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 51ms/step - loss: 0.0431 - val_loss: 0.0942 - lr: 3.3546e-07
Epoch 1/100
9/9 [==============================] - 5s 130ms/step - loss: 0.1463 - val_loss: 0.0795 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1222 - val_loss: 0.0751 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1121 - val_loss: 0.0766 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1082 - val_loss: 0.0735 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1014 - val_loss: 0.0674 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0953 - val_loss: 0.0766 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0893 - val_loss: 0.0754 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0847 - val_loss: 0.0789 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0785 - val_loss: 0.0827 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0755 - val_loss: 0.0754 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0702 - val_loss: 0.0640 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0677 - val_loss: 0.0644 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0647 - val_loss: 0.0730 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0612 - val_loss: 0.0780 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0607 - val_loss: 0.0727 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0596 - val_loss: 0.0682 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0582 - val_loss: 0.0663 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0577 - val_loss: 0.0749 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0568 - val_loss: 0.0703 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0551 - val_loss: 0.0639 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0550 - val_loss: 0.0665 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0534 - val_loss: 0.0662 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0524 - val_loss: 0.0662 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0522 - val_loss: 0.0630 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0518 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0516 - val_loss: 0.0643 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0522 - val_loss: 0.0644 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0513 - val_loss: 0.0640 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0505 - val_loss: 0.0652 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0512 - val_loss: 0.0647 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0505 - val_loss: 0.0638 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0509 - val_loss: 0.0639 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0516 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0499 - val_loss: 0.0637 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0502 - val_loss: 0.0638 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0513 - val_loss: 0.0637 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0509 - val_loss: 0.0637 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0518 - val_loss: 0.0640 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0501 - val_loss: 0.0641 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0503 - val_loss: 0.0641 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0505 - val_loss: 0.0641 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0497 - val_loss: 0.0641 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0508 - val_loss: 0.0641 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0504 - val_loss: 0.0641 - lr: 5.0045e-07
Epoch 1/100
13/13 [==============================] - 4s 99ms/step - loss: 0.1260 - val_loss: 0.1102 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1048 - val_loss: 0.1155 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0920 - val_loss: 0.0991 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0904 - val_loss: 0.0930 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0834 - val_loss: 0.0831 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0795 - val_loss: 0.0749 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0747 - val_loss: 0.0695 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0703 - val_loss: 0.0667 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0651 - val_loss: 0.0616 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0626 - val_loss: 0.0624 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0649 - val_loss: 0.0589 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0657 - val_loss: 0.0629 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0587 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0518 - val_loss: 0.0530 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0494 - val_loss: 0.0492 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0520 - val_loss: 0.0481 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0537 - val_loss: 0.0498 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0525 - val_loss: 0.0572 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0481 - val_loss: 0.0546 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0465 - val_loss: 0.0535 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0441 - val_loss: 0.0484 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0445 - val_loss: 0.0478 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0440 - val_loss: 0.0506 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0439 - val_loss: 0.0506 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0437 - val_loss: 0.0500 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0432 - val_loss: 0.0489 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0436 - val_loss: 0.0509 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0430 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0431 - val_loss: 0.0496 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0427 - val_loss: 0.0495 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0424 - val_loss: 0.0501 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0422 - val_loss: 0.0496 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0420 - val_loss: 0.0494 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0422 - val_loss: 0.0496 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0424 - val_loss: 0.0500 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0414 - val_loss: 0.0502 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0425 - val_loss: 0.0502 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0431 - val_loss: 0.0501 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0417 - val_loss: 0.0501 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0420 - val_loss: 0.0501 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0427 - val_loss: 0.0501 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0428 - val_loss: 0.0501 - lr: 1.1138e-06
Epoch 1/100
17/17 [==============================] - 5s 151ms/step - loss: 0.1129 - val_loss: 0.0976 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 50ms/step - loss: 0.0963 - val_loss: 0.1130 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 49ms/step - loss: 0.0952 - val_loss: 0.1086 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0903 - val_loss: 0.1074 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0889 - val_loss: 0.1076 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0869 - val_loss: 0.0883 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0755 - val_loss: 0.0918 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0703 - val_loss: 0.0916 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0675 - val_loss: 0.0851 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0696 - val_loss: 0.1049 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0772 - val_loss: 0.1168 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0852 - val_loss: 0.0678 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0611 - val_loss: 0.0768 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0630 - val_loss: 0.0820 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0683 - val_loss: 0.0753 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0681 - val_loss: 0.0560 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0546 - val_loss: 0.0577 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0539 - val_loss: 0.0535 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0530 - val_loss: 0.0536 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0522 - val_loss: 0.0513 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0520 - val_loss: 0.0457 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0493 - val_loss: 0.0436 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0481 - val_loss: 0.0437 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0462 - val_loss: 0.0433 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0460 - val_loss: 0.0433 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0461 - val_loss: 0.0422 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0455 - val_loss: 0.0420 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0460 - val_loss: 0.0415 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0453 - val_loss: 0.0415 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0452 - val_loss: 0.0413 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0449 - val_loss: 0.0413 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0449 - val_loss: 0.0410 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0439 - val_loss: 0.0410 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0448 - val_loss: 0.0409 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0442 - val_loss: 0.0409 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0441 - val_loss: 0.0409 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0438 - val_loss: 0.0409 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0442 - val_loss: 0.0409 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0449 - val_loss: 0.0409 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0445 - val_loss: 0.0409 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0447 - val_loss: 0.0409 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0449 - val_loss: 0.0409 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0441 - val_loss: 0.0409 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0443 - val_loss: 0.0409 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0445 - val_loss: 0.0409 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0447 - val_loss: 0.0409 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0446 - val_loss: 0.0409 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0445 - val_loss: 0.0409 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0443 - val_loss: 0.0409 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0437 - val_loss: 0.0409 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0441 - val_loss: 0.0409 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0438 - val_loss: 0.0409 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0448 - val_loss: 0.0409 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0448 - val_loss: 0.0409 - lr: 5.0435e-10
Epoch 1/100
22/22 [==============================] - 5s 60ms/step - loss: 0.1263 - val_loss: 0.1076 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1090 - val_loss: 0.1062 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0988 - val_loss: 0.1029 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0974 - val_loss: 0.1017 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0961 - val_loss: 0.1021 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0938 - val_loss: 0.1017 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0914 - val_loss: 0.0992 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0862 - val_loss: 0.0954 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0839 - val_loss: 0.0947 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0841 - val_loss: 0.0966 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0840 - val_loss: 0.0994 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0814 - val_loss: 0.0973 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0777 - val_loss: 0.0943 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0731 - val_loss: 0.0924 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0696 - val_loss: 0.0896 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0671 - val_loss: 0.0887 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0645 - val_loss: 0.0877 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0626 - val_loss: 0.0871 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0618 - val_loss: 0.0859 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0612 - val_loss: 0.0840 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0579 - val_loss: 0.0790 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0540 - val_loss: 0.0755 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0520 - val_loss: 0.0752 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0511 - val_loss: 0.0723 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0494 - val_loss: 0.0711 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0493 - val_loss: 0.0705 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0491 - val_loss: 0.0698 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0481 - val_loss: 0.0691 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0687 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0477 - val_loss: 0.0683 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0478 - val_loss: 0.0682 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0472 - val_loss: 0.0681 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0472 - val_loss: 0.0680 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0678 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0466 - val_loss: 0.0678 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0469 - val_loss: 0.0678 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0471 - val_loss: 0.0677 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0467 - val_loss: 0.0676 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0473 - val_loss: 0.0676 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0470 - val_loss: 0.0676 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0471 - val_loss: 0.0676 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0463 - val_loss: 0.0675 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0463 - val_loss: 0.0675 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0474 - val_loss: 0.0675 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0469 - val_loss: 0.0675 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0475 - val_loss: 0.0675 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 45ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 57ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 50ms/step - loss: 0.0460 - val_loss: 0.0675 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 49ms/step - loss: 0.0472 - val_loss: 0.0675 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 54ms/step - loss: 0.0471 - val_loss: 0.0675 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0470 - val_loss: 0.0675 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0468 - val_loss: 0.0675 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 51ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0468 - val_loss: 0.0675 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0464 - val_loss: 0.0675 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0459 - val_loss: 0.0675 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0470 - val_loss: 0.0675 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0675 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0468 - val_loss: 0.0675 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0462 - val_loss: 0.0675 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0472 - val_loss: 0.0675 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0464 - val_loss: 0.0675 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0470 - val_loss: 0.0675 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0472 - val_loss: 0.0675 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0675 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0475 - val_loss: 0.0675 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 2.2897e-14
Average Validation Loss: 0.06229816898703575
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 65ms/step - loss: 0.2367 - val_loss: 0.2575 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 16ms/step - loss: 0.2288 - val_loss: 0.2289 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 18ms/step - loss: 0.2075 - val_loss: 0.2204 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 17ms/step - loss: 0.2005 - val_loss: 0.2088 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1858 - val_loss: 0.2045 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1777 - val_loss: 0.1938 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1643 - val_loss: 0.1953 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1641 - val_loss: 0.1800 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1459 - val_loss: 0.1823 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 16ms/step - loss: 0.1229 - val_loss: 0.2187 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1431 - val_loss: 0.1828 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1295 - val_loss: 0.1558 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1218 - val_loss: 0.1523 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1115 - val_loss: 0.1532 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1032 - val_loss: 0.1498 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0967 - val_loss: 0.1430 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0949 - val_loss: 0.1388 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0916 - val_loss: 0.1439 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0900 - val_loss: 0.1445 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0900 - val_loss: 0.1330 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0927 - val_loss: 0.1390 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0894 - val_loss: 0.1472 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0880 - val_loss: 0.1351 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0866 - val_loss: 0.1435 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0862 - val_loss: 0.1366 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0830 - val_loss: 0.1407 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0860 - val_loss: 0.1404 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0862 - val_loss: 0.1373 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0849 - val_loss: 0.1356 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0835 - val_loss: 0.1400 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0839 - val_loss: 0.1355 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0849 - val_loss: 0.1367 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0853 - val_loss: 0.1379 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0824 - val_loss: 0.1386 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0858 - val_loss: 0.1377 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0836 - val_loss: 0.1380 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0832 - val_loss: 0.1371 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0823 - val_loss: 0.1365 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0844 - val_loss: 0.1367 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0829 - val_loss: 0.1368 - lr: 2.4788e-06
Epoch 1/100
34/34 [==============================] - 6s 57ms/step - loss: 0.2431 - val_loss: 0.2020 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 21ms/step - loss: 0.2230 - val_loss: 0.1598 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1975 - val_loss: 0.1512 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1833 - val_loss: 0.1309 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1687 - val_loss: 0.1272 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1619 - val_loss: 0.1084 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1539 - val_loss: 0.1224 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1459 - val_loss: 0.1006 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1411 - val_loss: 0.1240 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1307 - val_loss: 0.0956 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1297 - val_loss: 0.1022 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1231 - val_loss: 0.0889 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1192 - val_loss: 0.1093 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1123 - val_loss: 0.0880 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1077 - val_loss: 0.0986 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1010 - val_loss: 0.0961 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0999 - val_loss: 0.0843 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0956 - val_loss: 0.0838 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0893 - val_loss: 0.0815 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0846 - val_loss: 0.0801 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0820 - val_loss: 0.0753 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0827 - val_loss: 0.0718 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0793 - val_loss: 0.0729 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0748 - val_loss: 0.0729 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0731 - val_loss: 0.0730 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0722 - val_loss: 0.0737 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0707 - val_loss: 0.0750 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0693 - val_loss: 0.0750 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0696 - val_loss: 0.0760 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0687 - val_loss: 0.0755 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0686 - val_loss: 0.0759 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0694 - val_loss: 0.0750 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0680 - val_loss: 0.0755 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0674 - val_loss: 0.0759 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0679 - val_loss: 0.0764 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0680 - val_loss: 0.0763 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0681 - val_loss: 0.0762 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0673 - val_loss: 0.0764 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0675 - val_loss: 0.0762 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0686 - val_loss: 0.0762 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0670 - val_loss: 0.0762 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0672 - val_loss: 0.0762 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 11s 35ms/step - loss: 0.2357 - val_loss: 0.2039 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1929 - val_loss: 0.1693 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1741 - val_loss: 0.1511 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1531 - val_loss: 0.1367 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 25ms/step - loss: 0.1440 - val_loss: 0.1277 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 2s 31ms/step - loss: 0.1347 - val_loss: 0.1199 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 2s 33ms/step - loss: 0.1303 - val_loss: 0.1173 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 2s 32ms/step - loss: 0.1230 - val_loss: 0.1120 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 26ms/step - loss: 0.1199 - val_loss: 0.1125 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1152 - val_loss: 0.1037 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 26ms/step - loss: 0.1119 - val_loss: 0.1075 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 24ms/step - loss: 0.1058 - val_loss: 0.0991 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0991 - val_loss: 0.0891 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0982 - val_loss: 0.0909 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 2s 36ms/step - loss: 0.0882 - val_loss: 0.0767 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0871 - val_loss: 0.0843 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 2s 31ms/step - loss: 0.0819 - val_loss: 0.0736 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 2s 30ms/step - loss: 0.0782 - val_loss: 0.0742 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0756 - val_loss: 0.0693 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0710 - val_loss: 0.0690 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0697 - val_loss: 0.0657 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0681 - val_loss: 0.0665 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0664 - val_loss: 0.0640 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0650 - val_loss: 0.0659 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0657 - val_loss: 0.0645 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0636 - val_loss: 0.0632 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0654 - val_loss: 0.0613 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0643 - val_loss: 0.0600 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0614 - val_loss: 0.0599 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0625 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 2s 31ms/step - loss: 0.0618 - val_loss: 0.0596 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0606 - val_loss: 0.0599 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 2s 37ms/step - loss: 0.0595 - val_loss: 0.0599 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0606 - val_loss: 0.0602 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 3s 51ms/step - loss: 0.0597 - val_loss: 0.0601 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 2s 42ms/step - loss: 0.0602 - val_loss: 0.0601 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 2s 42ms/step - loss: 0.0591 - val_loss: 0.0600 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 2s 34ms/step - loss: 0.0588 - val_loss: 0.0599 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 2s 41ms/step - loss: 0.0598 - val_loss: 0.0599 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 2s 44ms/step - loss: 0.0595 - val_loss: 0.0599 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 2s 42ms/step - loss: 0.0592 - val_loss: 0.0599 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 3s 50ms/step - loss: 0.0585 - val_loss: 0.0600 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 2s 37ms/step - loss: 0.0590 - val_loss: 0.0600 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 2s 36ms/step - loss: 0.0599 - val_loss: 0.0599 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 2s 34ms/step - loss: 0.0592 - val_loss: 0.0600 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 2s 38ms/step - loss: 0.0595 - val_loss: 0.0600 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 2s 30ms/step - loss: 0.0596 - val_loss: 0.0600 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0605 - val_loss: 0.0600 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0602 - val_loss: 0.0600 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0597 - val_loss: 0.0600 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 2s 40ms/step - loss: 0.0599 - val_loss: 0.0600 - lr: 2.7536e-08
Epoch 1/100
68/68 [==============================] - 11s 47ms/step - loss: 0.2219 - val_loss: 0.2051 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 2s 22ms/step - loss: 0.1823 - val_loss: 0.1738 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1573 - val_loss: 0.1556 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 2s 25ms/step - loss: 0.1416 - val_loss: 0.1359 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 2s 23ms/step - loss: 0.1310 - val_loss: 0.1281 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 2s 26ms/step - loss: 0.1206 - val_loss: 0.1165 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 2s 36ms/step - loss: 0.1148 - val_loss: 0.1144 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 2s 31ms/step - loss: 0.1082 - val_loss: 0.1024 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 2s 29ms/step - loss: 0.1017 - val_loss: 0.0984 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 2s 34ms/step - loss: 0.0947 - val_loss: 0.1004 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0887 - val_loss: 0.1025 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0843 - val_loss: 0.0961 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0779 - val_loss: 0.0909 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0834 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0727 - val_loss: 0.0811 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0702 - val_loss: 0.0750 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0692 - val_loss: 0.0718 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0685 - val_loss: 0.0699 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0659 - val_loss: 0.0675 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0641 - val_loss: 0.0648 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0655 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0616 - val_loss: 0.0657 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0606 - val_loss: 0.0649 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0593 - val_loss: 0.0645 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0598 - val_loss: 0.0639 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0596 - val_loss: 0.0636 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0595 - val_loss: 0.0619 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0591 - val_loss: 0.0594 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0598 - val_loss: 0.0572 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0571 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0578 - val_loss: 0.0565 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0576 - val_loss: 0.0561 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0560 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0570 - val_loss: 0.0558 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0558 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0572 - val_loss: 0.0557 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0560 - val_loss: 0.0557 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0558 - val_loss: 0.0557 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0560 - val_loss: 0.0556 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0566 - val_loss: 0.0556 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0562 - val_loss: 0.0556 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0560 - val_loss: 0.0556 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0564 - val_loss: 0.0556 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0566 - val_loss: 0.0556 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0557 - val_loss: 0.0556 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0560 - val_loss: 0.0556 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0556 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0562 - val_loss: 0.0556 - lr: 6.9144e-16
Epoch 1/100
85/85 [==============================] - 5s 23ms/step - loss: 0.2190 - val_loss: 0.1845 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1725 - val_loss: 0.1540 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 26ms/step - loss: 0.1469 - val_loss: 0.1374 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 22ms/step - loss: 0.1339 - val_loss: 0.1251 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1221 - val_loss: 0.1167 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1110 - val_loss: 0.1156 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1083 - val_loss: 0.1157 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1029 - val_loss: 0.1020 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0938 - val_loss: 0.0981 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0897 - val_loss: 0.0960 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 3s 32ms/step - loss: 0.0820 - val_loss: 0.0951 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 3s 39ms/step - loss: 0.0790 - val_loss: 0.0946 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0767 - val_loss: 0.0902 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0762 - val_loss: 0.0876 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0705 - val_loss: 0.0960 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0711 - val_loss: 0.0925 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0669 - val_loss: 0.0921 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0655 - val_loss: 0.0949 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0638 - val_loss: 0.0908 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0635 - val_loss: 0.0868 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0599 - val_loss: 0.0821 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0762 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0562 - val_loss: 0.0706 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0543 - val_loss: 0.0700 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0527 - val_loss: 0.0695 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0517 - val_loss: 0.0687 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0512 - val_loss: 0.0688 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0686 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0497 - val_loss: 0.0684 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0509 - val_loss: 0.0682 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0507 - val_loss: 0.0681 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0512 - val_loss: 0.0676 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0505 - val_loss: 0.0675 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0501 - val_loss: 0.0675 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0497 - val_loss: 0.0674 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0496 - val_loss: 0.0674 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0495 - val_loss: 0.0674 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0491 - val_loss: 0.0674 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0490 - val_loss: 0.0674 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0485 - val_loss: 0.0674 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0483 - val_loss: 0.0674 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0495 - val_loss: 0.0674 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0494 - val_loss: 0.0674 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0491 - val_loss: 0.0674 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0491 - val_loss: 0.0674 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0489 - val_loss: 0.0674 - lr: 3.0590e-10
Average Validation Loss: 0.0774694599211216
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 6s 116ms/step - loss: 0.2358 - val_loss: 0.2795 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 24ms/step - loss: 0.2389 - val_loss: 0.2613 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 23ms/step - loss: 0.2290 - val_loss: 0.2301 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 23ms/step - loss: 0.2115 - val_loss: 0.2233 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1990 - val_loss: 0.2236 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1910 - val_loss: 0.2195 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1840 - val_loss: 0.2083 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1751 - val_loss: 0.1999 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1665 - val_loss: 0.1904 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 22ms/step - loss: 0.1531 - val_loss: 0.1782 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1392 - val_loss: 0.1700 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1308 - val_loss: 0.1628 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1223 - val_loss: 0.1839 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1218 - val_loss: 0.1697 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1157 - val_loss: 0.1653 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1127 - val_loss: 0.1654 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1101 - val_loss: 0.1600 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1092 - val_loss: 0.1642 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1067 - val_loss: 0.1636 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1062 - val_loss: 0.1550 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1040 - val_loss: 0.1609 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1047 - val_loss: 0.1548 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1008 - val_loss: 0.1537 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1004 - val_loss: 0.1555 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1007 - val_loss: 0.1540 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0997 - val_loss: 0.1551 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1012 - val_loss: 0.1518 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1015 - val_loss: 0.1538 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0993 - val_loss: 0.1517 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1007 - val_loss: 0.1508 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0996 - val_loss: 0.1529 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0986 - val_loss: 0.1536 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1004 - val_loss: 0.1538 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0991 - val_loss: 0.1537 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0993 - val_loss: 0.1530 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0981 - val_loss: 0.1525 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0978 - val_loss: 0.1524 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0982 - val_loss: 0.1524 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0991 - val_loss: 0.1523 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0983 - val_loss: 0.1523 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1004 - val_loss: 0.1522 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0981 - val_loss: 0.1522 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0973 - val_loss: 0.1522 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0991 - val_loss: 0.1522 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0991 - val_loss: 0.1522 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0985 - val_loss: 0.1522 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0994 - val_loss: 0.1522 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1000 - val_loss: 0.1522 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1000 - val_loss: 0.1522 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0983 - val_loss: 0.1522 - lr: 4.5400e-08
Epoch 1/100
17/17 [==============================] - 3s 61ms/step - loss: 0.2596 - val_loss: 0.1981 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 14ms/step - loss: 0.2345 - val_loss: 0.1824 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 14ms/step - loss: 0.2138 - val_loss: 0.1637 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 15ms/step - loss: 0.2002 - val_loss: 0.1527 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1885 - val_loss: 0.1493 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1773 - val_loss: 0.1385 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1654 - val_loss: 0.1385 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1540 - val_loss: 0.1345 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1476 - val_loss: 0.1352 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1404 - val_loss: 0.1268 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1314 - val_loss: 0.1297 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1250 - val_loss: 0.1294 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1175 - val_loss: 0.1196 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1138 - val_loss: 0.1176 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1075 - val_loss: 0.1153 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1039 - val_loss: 0.1092 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1017 - val_loss: 0.1022 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0980 - val_loss: 0.0987 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0959 - val_loss: 0.1000 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0916 - val_loss: 0.1046 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0904 - val_loss: 0.1090 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0918 - val_loss: 0.1026 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0887 - val_loss: 0.0980 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0879 - val_loss: 0.0992 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0876 - val_loss: 0.1004 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0864 - val_loss: 0.1004 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0867 - val_loss: 0.0994 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0877 - val_loss: 0.0978 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0855 - val_loss: 0.0982 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0840 - val_loss: 0.1004 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0859 - val_loss: 0.0981 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0851 - val_loss: 0.0976 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0846 - val_loss: 0.0978 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0856 - val_loss: 0.0987 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0838 - val_loss: 0.0983 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0858 - val_loss: 0.0978 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0860 - val_loss: 0.0978 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0855 - val_loss: 0.0977 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0855 - val_loss: 0.0978 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0846 - val_loss: 0.0977 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0851 - val_loss: 0.0976 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0862 - val_loss: 0.0977 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0849 - val_loss: 0.0977 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0977 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0860 - val_loss: 0.0977 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0843 - val_loss: 0.0978 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0841 - val_loss: 0.0978 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0847 - val_loss: 0.0978 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0851 - val_loss: 0.0978 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0852 - val_loss: 0.0978 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0841 - val_loss: 0.0978 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0855 - val_loss: 0.0978 - lr: 1.6702e-08
Epoch 1/100
26/26 [==============================] - 7s 73ms/step - loss: 0.2434 - val_loss: 0.2250 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 20ms/step - loss: 0.2067 - val_loss: 0.1915 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 19ms/step - loss: 0.1899 - val_loss: 0.1705 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1739 - val_loss: 0.1524 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 35ms/step - loss: 0.1585 - val_loss: 0.1390 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 39ms/step - loss: 0.1477 - val_loss: 0.1292 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 42ms/step - loss: 0.1335 - val_loss: 0.1180 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 37ms/step - loss: 0.1233 - val_loss: 0.1120 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 34ms/step - loss: 0.1140 - val_loss: 0.0986 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 34ms/step - loss: 0.1123 - val_loss: 0.1088 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 26ms/step - loss: 0.1062 - val_loss: 0.0924 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0996 - val_loss: 0.0935 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0947 - val_loss: 0.0868 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 30ms/step - loss: 0.0903 - val_loss: 0.0889 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0883 - val_loss: 0.0818 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0863 - val_loss: 0.0825 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0842 - val_loss: 0.0795 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0834 - val_loss: 0.0800 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0808 - val_loss: 0.0781 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0800 - val_loss: 0.0777 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 38ms/step - loss: 0.0815 - val_loss: 0.0767 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0827 - val_loss: 0.0766 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0866 - val_loss: 0.0916 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0823 - val_loss: 0.0911 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0788 - val_loss: 0.0873 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0776 - val_loss: 0.0856 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0771 - val_loss: 0.0872 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0762 - val_loss: 0.0850 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0750 - val_loss: 0.0842 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0758 - val_loss: 0.0849 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0749 - val_loss: 0.0839 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0748 - val_loss: 0.0841 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0734 - val_loss: 0.0830 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0747 - val_loss: 0.0828 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0736 - val_loss: 0.0827 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0736 - val_loss: 0.0825 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0739 - val_loss: 0.0826 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0740 - val_loss: 0.0827 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0740 - val_loss: 0.0828 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0735 - val_loss: 0.0828 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0738 - val_loss: 0.0829 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0727 - val_loss: 0.0829 - lr: 1.1138e-06
Epoch 1/100
34/34 [==============================] - 9s 71ms/step - loss: 0.2248 - val_loss: 0.2195 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 29ms/step - loss: 0.1928 - val_loss: 0.1871 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 28ms/step - loss: 0.1665 - val_loss: 0.1597 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1463 - val_loss: 0.1401 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1290 - val_loss: 0.1420 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1172 - val_loss: 0.1451 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1107 - val_loss: 0.1272 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1034 - val_loss: 0.1206 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0964 - val_loss: 0.1270 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0949 - val_loss: 0.1195 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0954 - val_loss: 0.1041 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0956 - val_loss: 0.0893 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0904 - val_loss: 0.0994 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0855 - val_loss: 0.0884 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0869 - val_loss: 0.0970 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0808 - val_loss: 0.0882 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0822 - val_loss: 0.1004 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0801 - val_loss: 0.0948 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0798 - val_loss: 0.1036 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0814 - val_loss: 0.1090 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0870 - val_loss: 0.1135 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0967 - val_loss: 0.0873 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0870 - val_loss: 0.0756 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0823 - val_loss: 0.0721 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0806 - val_loss: 0.0695 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0782 - val_loss: 0.0685 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0766 - val_loss: 0.0680 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0754 - val_loss: 0.0674 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0739 - val_loss: 0.0671 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0743 - val_loss: 0.0667 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0733 - val_loss: 0.0665 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0728 - val_loss: 0.0664 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0723 - val_loss: 0.0663 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0722 - val_loss: 0.0662 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0719 - val_loss: 0.0662 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0726 - val_loss: 0.0661 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0728 - val_loss: 0.0661 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0722 - val_loss: 0.0661 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0722 - val_loss: 0.0660 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0722 - val_loss: 0.0660 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0720 - val_loss: 0.0660 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0725 - val_loss: 0.0660 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0725 - val_loss: 0.0660 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0660 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0713 - val_loss: 0.0660 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0724 - val_loss: 0.0660 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0716 - val_loss: 0.0660 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0724 - val_loss: 0.0660 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0722 - val_loss: 0.0660 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0660 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0727 - val_loss: 0.0660 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0660 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0721 - val_loss: 0.0660 - lr: 2.2897e-14
Epoch 1/100
43/43 [==============================] - 6s 76ms/step - loss: 0.2236 - val_loss: 0.1967 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 2s 45ms/step - loss: 0.1878 - val_loss: 0.1728 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 31ms/step - loss: 0.1648 - val_loss: 0.1543 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 30ms/step - loss: 0.1486 - val_loss: 0.1422 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 29ms/step - loss: 0.1368 - val_loss: 0.1336 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 26ms/step - loss: 0.1296 - val_loss: 0.1277 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 26ms/step - loss: 0.1222 - val_loss: 0.1223 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1167 - val_loss: 0.1195 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 25ms/step - loss: 0.1102 - val_loss: 0.1172 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1072 - val_loss: 0.1194 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 2s 41ms/step - loss: 0.1036 - val_loss: 0.1111 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0990 - val_loss: 0.1088 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0969 - val_loss: 0.1040 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0903 - val_loss: 0.0980 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0856 - val_loss: 0.0986 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0820 - val_loss: 0.0943 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0785 - val_loss: 0.0908 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0772 - val_loss: 0.0882 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 2s 39ms/step - loss: 0.0737 - val_loss: 0.0864 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 2s 39ms/step - loss: 0.0721 - val_loss: 0.0845 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 2s 36ms/step - loss: 0.0707 - val_loss: 0.0831 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0692 - val_loss: 0.0832 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0676 - val_loss: 0.0824 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0664 - val_loss: 0.0813 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0653 - val_loss: 0.0807 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0644 - val_loss: 0.0796 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 2s 41ms/step - loss: 0.0645 - val_loss: 0.0790 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0640 - val_loss: 0.0786 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0642 - val_loss: 0.0783 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0635 - val_loss: 0.0773 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0633 - val_loss: 0.0770 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0631 - val_loss: 0.0767 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0626 - val_loss: 0.0766 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0624 - val_loss: 0.0765 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0630 - val_loss: 0.0764 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0623 - val_loss: 0.0763 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0624 - val_loss: 0.0762 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0626 - val_loss: 0.0762 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0618 - val_loss: 0.0762 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0622 - val_loss: 0.0762 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0628 - val_loss: 0.0762 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 2s 36ms/step - loss: 0.0620 - val_loss: 0.0762 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0624 - val_loss: 0.0762 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0624 - val_loss: 0.0762 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0622 - val_loss: 0.0762 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0621 - val_loss: 0.0762 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0613 - val_loss: 0.0762 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0627 - val_loss: 0.0762 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0618 - val_loss: 0.0762 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0615 - val_loss: 0.0762 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0622 - val_loss: 0.0762 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0630 - val_loss: 0.0762 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0627 - val_loss: 0.0762 - lr: 5.6464e-15
Average Validation Loss: 0.09343442767858505
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 7s 480ms/step - loss: 0.2401 - val_loss: 0.2560 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 74ms/step - loss: 0.2287 - val_loss: 0.2714 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 61ms/step - loss: 0.2349 - val_loss: 0.2642 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 71ms/step - loss: 0.2229 - val_loss: 0.2485 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 59ms/step - loss: 0.2177 - val_loss: 0.2348 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 51ms/step - loss: 0.2072 - val_loss: 0.2294 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 57ms/step - loss: 0.2001 - val_loss: 0.2277 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1911 - val_loss: 0.2252 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1875 - val_loss: 0.2142 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1738 - val_loss: 0.2022 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1602 - val_loss: 0.2016 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1504 - val_loss: 0.1877 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1449 - val_loss: 0.1968 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1391 - val_loss: 0.1911 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1361 - val_loss: 0.1888 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1335 - val_loss: 0.1979 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 62ms/step - loss: 0.1322 - val_loss: 0.1857 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1302 - val_loss: 0.1873 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 58ms/step - loss: 0.1292 - val_loss: 0.1838 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1257 - val_loss: 0.1853 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1259 - val_loss: 0.1868 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1252 - val_loss: 0.1801 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1240 - val_loss: 0.1807 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 57ms/step - loss: 0.1217 - val_loss: 0.1832 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1230 - val_loss: 0.1840 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1240 - val_loss: 0.1816 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1228 - val_loss: 0.1821 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1215 - val_loss: 0.1810 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 56ms/step - loss: 0.1236 - val_loss: 0.1799 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1231 - val_loss: 0.1792 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1205 - val_loss: 0.1795 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1193 - val_loss: 0.1800 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 78ms/step - loss: 0.1210 - val_loss: 0.1802 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1211 - val_loss: 0.1803 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1208 - val_loss: 0.1805 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1204 - val_loss: 0.1805 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 65ms/step - loss: 0.1196 - val_loss: 0.1805 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1211 - val_loss: 0.1805 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 93ms/step - loss: 0.1201 - val_loss: 0.1806 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1220 - val_loss: 0.1806 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1209 - val_loss: 0.1805 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 66ms/step - loss: 0.1209 - val_loss: 0.1805 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 68ms/step - loss: 0.1213 - val_loss: 0.1805 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1212 - val_loss: 0.1805 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1223 - val_loss: 0.1805 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 66ms/step - loss: 0.1214 - val_loss: 0.1805 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1229 - val_loss: 0.1805 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 65ms/step - loss: 0.1221 - val_loss: 0.1805 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 68ms/step - loss: 0.1233 - val_loss: 0.1805 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1203 - val_loss: 0.1805 - lr: 4.5400e-08
Epoch 1/100
9/9 [==============================] - 8s 178ms/step - loss: 0.2578 - val_loss: 0.2002 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 42ms/step - loss: 0.2343 - val_loss: 0.1981 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 43ms/step - loss: 0.2179 - val_loss: 0.1942 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 34ms/step - loss: 0.2068 - val_loss: 0.1709 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1917 - val_loss: 0.1855 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 1s 72ms/step - loss: 0.1795 - val_loss: 0.1813 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 1s 60ms/step - loss: 0.1750 - val_loss: 0.1709 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1609 - val_loss: 0.1794 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1574 - val_loss: 0.1749 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1536 - val_loss: 0.1563 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 46ms/step - loss: 0.1459 - val_loss: 0.1555 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1380 - val_loss: 0.1613 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1358 - val_loss: 0.1474 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1331 - val_loss: 0.1378 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1275 - val_loss: 0.1431 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1236 - val_loss: 0.1360 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 1s 66ms/step - loss: 0.1215 - val_loss: 0.1355 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 47ms/step - loss: 0.1192 - val_loss: 0.1318 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1169 - val_loss: 0.1289 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1162 - val_loss: 0.1253 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1143 - val_loss: 0.1289 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1138 - val_loss: 0.1230 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1111 - val_loss: 0.1236 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1113 - val_loss: 0.1236 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1103 - val_loss: 0.1201 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1103 - val_loss: 0.1199 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1085 - val_loss: 0.1198 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1086 - val_loss: 0.1199 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1086 - val_loss: 0.1167 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1084 - val_loss: 0.1181 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 1s 43ms/step - loss: 0.1072 - val_loss: 0.1181 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1083 - val_loss: 0.1185 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1078 - val_loss: 0.1184 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1087 - val_loss: 0.1178 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1076 - val_loss: 0.1180 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1064 - val_loss: 0.1179 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1073 - val_loss: 0.1182 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1069 - val_loss: 0.1183 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1068 - val_loss: 0.1182 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1078 - val_loss: 0.1183 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 1s 62ms/step - loss: 0.1082 - val_loss: 0.1183 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 56ms/step - loss: 0.1077 - val_loss: 0.1183 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 57ms/step - loss: 0.1066 - val_loss: 0.1184 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1090 - val_loss: 0.1184 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1064 - val_loss: 0.1184 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1089 - val_loss: 0.1183 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1075 - val_loss: 0.1183 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1055 - val_loss: 0.1183 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1079 - val_loss: 0.1183 - lr: 6.7729e-08
Epoch 1/100
13/13 [==============================] - 7s 168ms/step - loss: 0.2616 - val_loss: 0.2274 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 1s 54ms/step - loss: 0.2243 - val_loss: 0.2258 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 1s 57ms/step - loss: 0.2004 - val_loss: 0.2005 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 1s 44ms/step - loss: 0.1922 - val_loss: 0.1895 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1788 - val_loss: 0.1758 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 38ms/step - loss: 0.1696 - val_loss: 0.1635 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1616 - val_loss: 0.1541 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1535 - val_loss: 0.1473 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 39ms/step - loss: 0.1448 - val_loss: 0.1406 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 34ms/step - loss: 0.1400 - val_loss: 0.1343 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 33ms/step - loss: 0.1328 - val_loss: 0.1301 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1289 - val_loss: 0.1242 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1210 - val_loss: 0.1219 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1178 - val_loss: 0.1183 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 33ms/step - loss: 0.1161 - val_loss: 0.1150 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 36ms/step - loss: 0.1163 - val_loss: 0.1112 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 34ms/step - loss: 0.1094 - val_loss: 0.1091 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1048 - val_loss: 0.1073 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1035 - val_loss: 0.1040 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 36ms/step - loss: 0.1007 - val_loss: 0.1025 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0999 - val_loss: 0.1005 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0970 - val_loss: 0.0991 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0971 - val_loss: 0.0981 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0949 - val_loss: 0.0969 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0943 - val_loss: 0.0966 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0936 - val_loss: 0.0963 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0930 - val_loss: 0.0956 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0930 - val_loss: 0.0956 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0923 - val_loss: 0.0951 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0919 - val_loss: 0.0952 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0921 - val_loss: 0.0948 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0929 - val_loss: 0.0947 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0912 - val_loss: 0.0947 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0923 - val_loss: 0.0946 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0915 - val_loss: 0.0945 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0912 - val_loss: 0.0945 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 1s 67ms/step - loss: 0.0916 - val_loss: 0.0944 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 1s 50ms/step - loss: 0.0910 - val_loss: 0.0945 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0921 - val_loss: 0.0945 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0900 - val_loss: 0.0945 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0911 - val_loss: 0.0945 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 1s 48ms/step - loss: 0.0917 - val_loss: 0.0945 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0918 - val_loss: 0.0945 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0910 - val_loss: 0.0945 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0916 - val_loss: 0.0945 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0910 - val_loss: 0.0945 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0911 - val_loss: 0.0945 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0919 - val_loss: 0.0945 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0918 - val_loss: 0.0945 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0913 - val_loss: 0.0944 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0912 - val_loss: 0.0944 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0914 - val_loss: 0.0944 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0914 - val_loss: 0.0944 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0916 - val_loss: 0.0944 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0919 - val_loss: 0.0944 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0911 - val_loss: 0.0944 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0913 - val_loss: 0.0944 - lr: 1.3710e-09
Epoch 1/100
17/17 [==============================] - 10s 126ms/step - loss: 0.2393 - val_loss: 0.2136 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 37ms/step - loss: 0.2117 - val_loss: 0.1987 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 40ms/step - loss: 0.1903 - val_loss: 0.1918 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 37ms/step - loss: 0.1770 - val_loss: 0.1906 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 42ms/step - loss: 0.1674 - val_loss: 0.1763 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 1s 42ms/step - loss: 0.1572 - val_loss: 0.1624 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 1s 36ms/step - loss: 0.1464 - val_loss: 0.1567 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 1s 38ms/step - loss: 0.1384 - val_loss: 0.1577 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 1s 48ms/step - loss: 0.1365 - val_loss: 0.1373 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 40ms/step - loss: 0.1262 - val_loss: 0.1291 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 1s 38ms/step - loss: 0.1171 - val_loss: 0.1232 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 39ms/step - loss: 0.1095 - val_loss: 0.1215 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 36ms/step - loss: 0.1044 - val_loss: 0.1279 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 35ms/step - loss: 0.1042 - val_loss: 0.1285 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 43ms/step - loss: 0.1077 - val_loss: 0.1243 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 44ms/step - loss: 0.1139 - val_loss: 0.0905 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0966 - val_loss: 0.0897 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0931 - val_loss: 0.0904 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0937 - val_loss: 0.0871 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0939 - val_loss: 0.0829 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0910 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0880 - val_loss: 0.0789 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0871 - val_loss: 0.0786 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0858 - val_loss: 0.0774 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 47ms/step - loss: 0.0852 - val_loss: 0.0773 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0846 - val_loss: 0.0763 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0837 - val_loss: 0.0760 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0841 - val_loss: 0.0759 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0841 - val_loss: 0.0762 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0838 - val_loss: 0.0754 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0833 - val_loss: 0.0751 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0828 - val_loss: 0.0752 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0822 - val_loss: 0.0753 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0824 - val_loss: 0.0754 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0830 - val_loss: 0.0755 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 1s 56ms/step - loss: 0.0829 - val_loss: 0.0754 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0828 - val_loss: 0.0754 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0821 - val_loss: 0.0754 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0824 - val_loss: 0.0753 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0831 - val_loss: 0.0753 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0823 - val_loss: 0.0753 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0820 - val_loss: 0.0753 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0827 - val_loss: 0.0753 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 51ms/step - loss: 0.0814 - val_loss: 0.0753 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 53ms/step - loss: 0.0826 - val_loss: 0.0753 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 1s 52ms/step - loss: 0.0836 - val_loss: 0.0752 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0816 - val_loss: 0.0752 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 1s 48ms/step - loss: 0.0824 - val_loss: 0.0752 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0824 - val_loss: 0.0752 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 78ms/step - loss: 0.0831 - val_loss: 0.0752 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 55ms/step - loss: 0.0826 - val_loss: 0.0752 - lr: 2.7536e-08
Epoch 1/100
22/22 [==============================] - 8s 94ms/step - loss: 0.2429 - val_loss: 0.2170 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 36ms/step - loss: 0.2103 - val_loss: 0.2022 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 39ms/step - loss: 0.1872 - val_loss: 0.1836 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 40ms/step - loss: 0.1709 - val_loss: 0.1711 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 37ms/step - loss: 0.1592 - val_loss: 0.1648 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 38ms/step - loss: 0.1512 - val_loss: 0.1540 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 38ms/step - loss: 0.1401 - val_loss: 0.1477 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 37ms/step - loss: 0.1323 - val_loss: 0.1421 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 42ms/step - loss: 0.1271 - val_loss: 0.1368 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 38ms/step - loss: 0.1210 - val_loss: 0.1332 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 36ms/step - loss: 0.1152 - val_loss: 0.1295 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 33ms/step - loss: 0.1117 - val_loss: 0.1268 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1079 - val_loss: 0.1230 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1024 - val_loss: 0.1201 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0990 - val_loss: 0.1152 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0940 - val_loss: 0.1133 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0917 - val_loss: 0.1110 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0884 - val_loss: 0.1072 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0861 - val_loss: 0.1064 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0852 - val_loss: 0.1028 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0817 - val_loss: 0.0992 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0797 - val_loss: 0.0953 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0779 - val_loss: 0.0927 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0760 - val_loss: 0.0906 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0752 - val_loss: 0.0885 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0745 - val_loss: 0.0882 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0736 - val_loss: 0.0871 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0728 - val_loss: 0.0865 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0725 - val_loss: 0.0861 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0722 - val_loss: 0.0858 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0722 - val_loss: 0.0855 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0710 - val_loss: 0.0853 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0714 - val_loss: 0.0852 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0722 - val_loss: 0.0851 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0720 - val_loss: 0.0851 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0707 - val_loss: 0.0850 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0716 - val_loss: 0.0850 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0715 - val_loss: 0.0849 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0716 - val_loss: 0.0849 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0718 - val_loss: 0.0849 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0711 - val_loss: 0.0849 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0711 - val_loss: 0.0849 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0701 - val_loss: 0.0849 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 49ms/step - loss: 0.0714 - val_loss: 0.0849 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 52ms/step - loss: 0.0713 - val_loss: 0.0849 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 50ms/step - loss: 0.0706 - val_loss: 0.0849 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0707 - val_loss: 0.0849 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0713 - val_loss: 0.0849 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0702 - val_loss: 0.0849 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0706 - val_loss: 0.0849 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0705 - val_loss: 0.0849 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0708 - val_loss: 0.0849 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0718 - val_loss: 0.0849 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0709 - val_loss: 0.0849 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0707 - val_loss: 0.0849 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0709 - val_loss: 0.0849 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0715 - val_loss: 0.0849 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0715 - val_loss: 0.0849 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0705 - val_loss: 0.0849 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0717 - val_loss: 0.0849 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0711 - val_loss: 0.0849 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0714 - val_loss: 0.0849 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0713 - val_loss: 0.0849 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0707 - val_loss: 0.0849 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0705 - val_loss: 0.0849 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0718 - val_loss: 0.0849 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0717 - val_loss: 0.0849 - lr: 1.1370e-14
Average Validation Loss: 0.110069240629673
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 6s 109ms/step - loss: 0.2105 - val_loss: 0.2637 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 1s 33ms/step - loss: 0.2267 - val_loss: 0.2137 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 1s 36ms/step - loss: 0.1925 - val_loss: 0.2056 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 1s 36ms/step - loss: 0.1821 - val_loss: 0.1984 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 1s 33ms/step - loss: 0.1747 - val_loss: 0.1864 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1594 - val_loss: 0.1818 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1443 - val_loss: 0.2007 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1588 - val_loss: 0.1570 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1294 - val_loss: 0.1572 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1108 - val_loss: 0.1549 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1131 - val_loss: 0.1568 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1061 - val_loss: 0.1687 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 1s 30ms/step - loss: 0.1073 - val_loss: 0.1525 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 1s 33ms/step - loss: 0.1020 - val_loss: 0.1334 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 1s 49ms/step - loss: 0.0988 - val_loss: 0.1287 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0969 - val_loss: 0.1537 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0985 - val_loss: 0.1448 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0914 - val_loss: 0.1314 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 1s 38ms/step - loss: 0.0868 - val_loss: 0.1341 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 1s 35ms/step - loss: 0.0846 - val_loss: 0.1362 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 1s 35ms/step - loss: 0.0814 - val_loss: 0.1361 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 1s 36ms/step - loss: 0.0828 - val_loss: 0.1350 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0837 - val_loss: 0.1353 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0807 - val_loss: 0.1290 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0815 - val_loss: 0.1328 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0813 - val_loss: 0.1326 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0817 - val_loss: 0.1263 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0800 - val_loss: 0.1326 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0801 - val_loss: 0.1274 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 1s 42ms/step - loss: 0.0790 - val_loss: 0.1302 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0787 - val_loss: 0.1292 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0781 - val_loss: 0.1289 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0770 - val_loss: 0.1287 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0785 - val_loss: 0.1287 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0778 - val_loss: 0.1300 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0794 - val_loss: 0.1308 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0777 - val_loss: 0.1311 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0776 - val_loss: 0.1312 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0774 - val_loss: 0.1312 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 1s 34ms/step - loss: 0.0796 - val_loss: 0.1312 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0789 - val_loss: 0.1312 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0794 - val_loss: 0.1311 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0779 - val_loss: 0.1310 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0771 - val_loss: 0.1310 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0775 - val_loss: 0.1311 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0783 - val_loss: 0.1311 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0778 - val_loss: 0.1310 - lr: 1.5073e-07
Epoch 1/100
34/34 [==============================] - 7s 77ms/step - loss: 0.2445 - val_loss: 0.1781 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 28ms/step - loss: 0.2142 - val_loss: 0.1568 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1939 - val_loss: 0.1423 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 28ms/step - loss: 0.1826 - val_loss: 0.1276 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 30ms/step - loss: 0.1699 - val_loss: 0.1248 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 43ms/step - loss: 0.1590 - val_loss: 0.1134 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 37ms/step - loss: 0.1533 - val_loss: 0.1178 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 35ms/step - loss: 0.1475 - val_loss: 0.1045 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 36ms/step - loss: 0.1398 - val_loss: 0.1332 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 32ms/step - loss: 0.1352 - val_loss: 0.1054 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 36ms/step - loss: 0.1348 - val_loss: 0.1271 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1279 - val_loss: 0.0882 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 36ms/step - loss: 0.1223 - val_loss: 0.1150 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 34ms/step - loss: 0.1170 - val_loss: 0.0994 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 42ms/step - loss: 0.1146 - val_loss: 0.1084 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1065 - val_loss: 0.1033 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 32ms/step - loss: 0.1025 - val_loss: 0.1055 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0983 - val_loss: 0.0962 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0950 - val_loss: 0.0978 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0916 - val_loss: 0.0911 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0874 - val_loss: 0.0892 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0834 - val_loss: 0.0829 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0824 - val_loss: 0.0812 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0771 - val_loss: 0.0832 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0768 - val_loss: 0.0850 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0736 - val_loss: 0.0874 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0743 - val_loss: 0.0877 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0729 - val_loss: 0.0846 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0728 - val_loss: 0.0847 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0731 - val_loss: 0.0872 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0729 - val_loss: 0.0872 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0734 - val_loss: 0.0894 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0732 - val_loss: 0.0900 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0715 - val_loss: 0.0888 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0708 - val_loss: 0.0885 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0710 - val_loss: 0.0874 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0706 - val_loss: 0.0877 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0716 - val_loss: 0.0879 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0703 - val_loss: 0.0878 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0706 - val_loss: 0.0880 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 2s 51ms/step - loss: 0.0704 - val_loss: 0.0880 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0707 - val_loss: 0.0879 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0720 - val_loss: 0.0880 - lr: 7.4659e-07
Epoch 1/100
51/51 [==============================] - 14s 80ms/step - loss: 0.2222 - val_loss: 0.1963 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 2s 31ms/step - loss: 0.1915 - val_loss: 0.1703 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1717 - val_loss: 0.1534 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 25ms/step - loss: 0.1559 - val_loss: 0.1420 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 23ms/step - loss: 0.1469 - val_loss: 0.1356 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 24ms/step - loss: 0.1397 - val_loss: 0.1305 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 29ms/step - loss: 0.1367 - val_loss: 0.1265 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 2s 35ms/step - loss: 0.1307 - val_loss: 0.1243 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 2s 33ms/step - loss: 0.1245 - val_loss: 0.1136 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 27ms/step - loss: 0.1225 - val_loss: 0.1166 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 2s 31ms/step - loss: 0.1172 - val_loss: 0.1060 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 27ms/step - loss: 0.1118 - val_loss: 0.1093 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 2s 32ms/step - loss: 0.1083 - val_loss: 0.1010 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0994 - val_loss: 0.0966 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0964 - val_loss: 0.0943 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0910 - val_loss: 0.0860 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0884 - val_loss: 0.0878 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 2s 33ms/step - loss: 0.0834 - val_loss: 0.0809 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0781 - val_loss: 0.0781 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0755 - val_loss: 0.0791 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0728 - val_loss: 0.0745 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0708 - val_loss: 0.0735 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0677 - val_loss: 0.0731 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0697 - val_loss: 0.0725 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0686 - val_loss: 0.0706 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0686 - val_loss: 0.0680 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0661 - val_loss: 0.0672 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0665 - val_loss: 0.0663 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0653 - val_loss: 0.0664 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0636 - val_loss: 0.0661 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0633 - val_loss: 0.0659 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0620 - val_loss: 0.0658 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0632 - val_loss: 0.0658 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0619 - val_loss: 0.0660 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 2s 41ms/step - loss: 0.0626 - val_loss: 0.0659 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 2s 36ms/step - loss: 0.0618 - val_loss: 0.0658 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0631 - val_loss: 0.0657 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 2s 33ms/step - loss: 0.0625 - val_loss: 0.0658 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0617 - val_loss: 0.0658 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0614 - val_loss: 0.0658 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0622 - val_loss: 0.0658 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0621 - val_loss: 0.0658 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0658 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0613 - val_loss: 0.0658 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0621 - val_loss: 0.0658 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 2s 38ms/step - loss: 0.0621 - val_loss: 0.0658 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0626 - val_loss: 0.0658 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0615 - val_loss: 0.0658 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0614 - val_loss: 0.0658 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0613 - val_loss: 0.0658 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0610 - val_loss: 0.0658 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0616 - val_loss: 0.0658 - lr: 1.6702e-08
Epoch 53/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0624 - val_loss: 0.0658 - lr: 1.0130e-08
Epoch 54/100
51/51 [==============================] - 2s 30ms/step - loss: 0.0620 - val_loss: 0.0658 - lr: 6.1442e-09
Epoch 55/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0658 - lr: 3.7267e-09
Epoch 56/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0612 - val_loss: 0.0658 - lr: 2.2603e-09
Epoch 57/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0612 - val_loss: 0.0658 - lr: 1.3710e-09
Epoch 1/100
68/68 [==============================] - 6s 34ms/step - loss: 0.2187 - val_loss: 0.2108 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1811 - val_loss: 0.1916 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1591 - val_loss: 0.1479 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1416 - val_loss: 0.1608 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1371 - val_loss: 0.1275 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 2s 27ms/step - loss: 0.1240 - val_loss: 0.1235 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 2s 28ms/step - loss: 0.1192 - val_loss: 0.1131 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 2s 25ms/step - loss: 0.1089 - val_loss: 0.1200 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1046 - val_loss: 0.1306 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1008 - val_loss: 0.1175 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0940 - val_loss: 0.1112 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0874 - val_loss: 0.0990 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0825 - val_loss: 0.0904 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0787 - val_loss: 0.0868 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0825 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0742 - val_loss: 0.0776 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0709 - val_loss: 0.0762 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0700 - val_loss: 0.0718 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0685 - val_loss: 0.0718 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0667 - val_loss: 0.0711 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0658 - val_loss: 0.0693 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0636 - val_loss: 0.0672 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0630 - val_loss: 0.0688 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0612 - val_loss: 0.0701 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0616 - val_loss: 0.0675 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0614 - val_loss: 0.0676 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0616 - val_loss: 0.0642 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0605 - val_loss: 0.0623 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0586 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0592 - val_loss: 0.0579 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0589 - val_loss: 0.0568 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0587 - val_loss: 0.0563 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0584 - val_loss: 0.0561 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0575 - val_loss: 0.0558 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0576 - val_loss: 0.0557 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0574 - val_loss: 0.0557 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0577 - val_loss: 0.0558 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0571 - val_loss: 0.0557 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0574 - val_loss: 0.0557 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0570 - val_loss: 0.0557 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 2s 31ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0577 - val_loss: 0.0556 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0573 - val_loss: 0.0556 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0572 - val_loss: 0.0556 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0582 - val_loss: 0.0556 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 34ms/step - loss: 0.0572 - val_loss: 0.0556 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0574 - val_loss: 0.0556 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0571 - val_loss: 0.0556 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0572 - val_loss: 0.0556 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0578 - val_loss: 0.0556 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0574 - val_loss: 0.0556 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0575 - val_loss: 0.0556 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0575 - val_loss: 0.0556 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0577 - val_loss: 0.0556 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0581 - val_loss: 0.0556 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 2s 31ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 3s 37ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 2s 36ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 2s 36ms/step - loss: 0.0573 - val_loss: 0.0556 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 2s 37ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 3s 37ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 2s 31ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0562 - val_loss: 0.0556 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0578 - val_loss: 0.0556 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0575 - val_loss: 0.0556 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 3s 38ms/step - loss: 0.0579 - val_loss: 0.0556 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 3s 40ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 2.8039e-15
Epoch 1/100
85/85 [==============================] - 12s 51ms/step - loss: 0.2168 - val_loss: 0.1819 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 3s 33ms/step - loss: 0.1751 - val_loss: 0.1562 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 23ms/step - loss: 0.1522 - val_loss: 0.1418 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1374 - val_loss: 0.1327 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 2s 25ms/step - loss: 0.1287 - val_loss: 0.1248 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 3s 33ms/step - loss: 0.1207 - val_loss: 0.1194 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 25ms/step - loss: 0.1139 - val_loss: 0.1190 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 22ms/step - loss: 0.1105 - val_loss: 0.1112 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0963 - val_loss: 0.1045 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0919 - val_loss: 0.1001 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0873 - val_loss: 0.0959 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 29ms/step - loss: 0.0815 - val_loss: 0.0911 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0783 - val_loss: 0.0879 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0741 - val_loss: 0.0871 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0758 - val_loss: 0.0832 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0703 - val_loss: 0.0813 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0683 - val_loss: 0.0800 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0656 - val_loss: 0.0781 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0659 - val_loss: 0.0761 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0630 - val_loss: 0.0763 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0616 - val_loss: 0.0754 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0602 - val_loss: 0.0718 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0581 - val_loss: 0.0704 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0565 - val_loss: 0.0699 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0556 - val_loss: 0.0687 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0538 - val_loss: 0.0680 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0519 - val_loss: 0.0674 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0528 - val_loss: 0.0679 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0522 - val_loss: 0.0676 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0512 - val_loss: 0.0669 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0519 - val_loss: 0.0671 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0511 - val_loss: 0.0670 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0517 - val_loss: 0.0668 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0515 - val_loss: 0.0667 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0515 - val_loss: 0.0665 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0509 - val_loss: 0.0664 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0518 - val_loss: 0.0663 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 3s 35ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0503 - val_loss: 0.0663 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0500 - val_loss: 0.0663 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0511 - val_loss: 0.0663 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0515 - val_loss: 0.0663 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0512 - val_loss: 0.0663 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0515 - val_loss: 0.0663 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0511 - val_loss: 0.0663 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0500 - val_loss: 0.0663 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0663 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0498 - val_loss: 0.0663 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0663 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0663 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0513 - val_loss: 0.0663 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 5.6464e-15
Average Validation Loss: 0.07903297692537307
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 8s 208ms/step - loss: 0.2174 - val_loss: 0.2670 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 1s 67ms/step - loss: 0.2264 - val_loss: 0.2464 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 44ms/step - loss: 0.2146 - val_loss: 0.2102 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1948 - val_loss: 0.2043 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1796 - val_loss: 0.2085 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1790 - val_loss: 0.1949 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 1s 60ms/step - loss: 0.1639 - val_loss: 0.1847 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1517 - val_loss: 0.1733 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 55ms/step - loss: 0.1376 - val_loss: 0.1616 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1275 - val_loss: 0.1608 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1218 - val_loss: 0.1919 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1302 - val_loss: 0.1677 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1168 - val_loss: 0.1509 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1122 - val_loss: 0.1702 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 54ms/step - loss: 0.1121 - val_loss: 0.1570 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1106 - val_loss: 0.1491 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1074 - val_loss: 0.1585 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1041 - val_loss: 0.1503 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 56ms/step - loss: 0.1012 - val_loss: 0.1511 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1037 - val_loss: 0.1461 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1005 - val_loss: 0.1521 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 47ms/step - loss: 0.1009 - val_loss: 0.1461 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0980 - val_loss: 0.1453 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0994 - val_loss: 0.1423 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0977 - val_loss: 0.1498 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1001 - val_loss: 0.1488 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0979 - val_loss: 0.1454 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0964 - val_loss: 0.1438 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0980 - val_loss: 0.1469 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0980 - val_loss: 0.1460 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0966 - val_loss: 0.1449 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0964 - val_loss: 0.1447 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0963 - val_loss: 0.1447 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0972 - val_loss: 0.1448 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 51ms/step - loss: 0.0966 - val_loss: 0.1446 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 58ms/step - loss: 0.0963 - val_loss: 0.1449 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 57ms/step - loss: 0.0963 - val_loss: 0.1448 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 46ms/step - loss: 0.0972 - val_loss: 0.1446 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0959 - val_loss: 0.1445 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0956 - val_loss: 0.1445 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0964 - val_loss: 0.1445 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0967 - val_loss: 0.1445 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0965 - val_loss: 0.1444 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0961 - val_loss: 0.1444 - lr: 5.0045e-07
Epoch 1/100
17/17 [==============================] - 5s 67ms/step - loss: 0.2384 - val_loss: 0.1803 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 21ms/step - loss: 0.2152 - val_loss: 0.1717 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1975 - val_loss: 0.1483 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1870 - val_loss: 0.1440 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1735 - val_loss: 0.1420 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1666 - val_loss: 0.1273 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1517 - val_loss: 0.1335 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 1s 28ms/step - loss: 0.1364 - val_loss: 0.1464 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1407 - val_loss: 0.1105 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1403 - val_loss: 0.1083 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1202 - val_loss: 0.1136 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1127 - val_loss: 0.1189 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 30ms/step - loss: 0.1113 - val_loss: 0.1088 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1089 - val_loss: 0.0963 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1048 - val_loss: 0.0917 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1024 - val_loss: 0.0913 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0976 - val_loss: 0.0934 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0923 - val_loss: 0.0929 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0894 - val_loss: 0.0897 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0888 - val_loss: 0.0884 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0868 - val_loss: 0.0888 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0863 - val_loss: 0.0954 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0852 - val_loss: 0.0899 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0838 - val_loss: 0.0910 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0849 - val_loss: 0.0875 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0818 - val_loss: 0.0882 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0832 - val_loss: 0.0887 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0817 - val_loss: 0.0884 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0829 - val_loss: 0.0881 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0816 - val_loss: 0.0892 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0822 - val_loss: 0.0889 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0814 - val_loss: 0.0892 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0821 - val_loss: 0.0886 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0816 - val_loss: 0.0878 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0812 - val_loss: 0.0883 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0816 - val_loss: 0.0889 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0823 - val_loss: 0.0891 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0819 - val_loss: 0.0893 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0823 - val_loss: 0.0892 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0819 - val_loss: 0.0891 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0825 - val_loss: 0.0891 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0891 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0804 - val_loss: 0.0891 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0808 - val_loss: 0.0892 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0823 - val_loss: 0.0891 - lr: 3.3546e-07
Epoch 1/100
26/26 [==============================] - 6s 64ms/step - loss: 0.2216 - val_loss: 0.2172 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 28ms/step - loss: 0.1979 - val_loss: 0.1879 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1828 - val_loss: 0.1760 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1681 - val_loss: 0.1578 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1587 - val_loss: 0.1457 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1478 - val_loss: 0.1333 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1408 - val_loss: 0.1276 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1327 - val_loss: 0.1196 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1255 - val_loss: 0.1135 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1195 - val_loss: 0.1034 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1118 - val_loss: 0.1023 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 27ms/step - loss: 0.1040 - val_loss: 0.0888 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1026 - val_loss: 0.0944 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0959 - val_loss: 0.0832 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0920 - val_loss: 0.0839 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0904 - val_loss: 0.0816 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0884 - val_loss: 0.0814 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 48ms/step - loss: 0.0866 - val_loss: 0.0801 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 47ms/step - loss: 0.0856 - val_loss: 0.0807 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 44ms/step - loss: 0.0853 - val_loss: 0.0794 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 50ms/step - loss: 0.0847 - val_loss: 0.0776 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0872 - val_loss: 0.0746 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 52ms/step - loss: 0.0853 - val_loss: 0.0782 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 42ms/step - loss: 0.0831 - val_loss: 0.0814 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 45ms/step - loss: 0.0806 - val_loss: 0.0812 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0793 - val_loss: 0.0816 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0774 - val_loss: 0.0793 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 42ms/step - loss: 0.0772 - val_loss: 0.0800 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 30ms/step - loss: 0.0764 - val_loss: 0.0792 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0770 - val_loss: 0.0806 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0764 - val_loss: 0.0788 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0742 - val_loss: 0.0787 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0753 - val_loss: 0.0783 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0757 - val_loss: 0.0790 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0754 - val_loss: 0.0788 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 43ms/step - loss: 0.0757 - val_loss: 0.0787 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 36ms/step - loss: 0.0749 - val_loss: 0.0787 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0756 - val_loss: 0.0787 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0747 - val_loss: 0.0786 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 30ms/step - loss: 0.0756 - val_loss: 0.0786 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0749 - val_loss: 0.0787 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0754 - val_loss: 0.0787 - lr: 1.1138e-06
Epoch 1/100
34/34 [==============================] - 6s 51ms/step - loss: 0.2307 - val_loss: 0.1994 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1920 - val_loss: 0.2005 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1738 - val_loss: 0.1736 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1557 - val_loss: 0.1587 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 39ms/step - loss: 0.1425 - val_loss: 0.1458 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 32ms/step - loss: 0.1330 - val_loss: 0.1392 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 31ms/step - loss: 0.1254 - val_loss: 0.1299 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 29ms/step - loss: 0.1194 - val_loss: 0.1205 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1121 - val_loss: 0.1152 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1060 - val_loss: 0.1113 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1019 - val_loss: 0.1081 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0975 - val_loss: 0.1078 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0956 - val_loss: 0.1023 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0906 - val_loss: 0.1042 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0885 - val_loss: 0.1002 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0875 - val_loss: 0.1066 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0863 - val_loss: 0.1072 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0851 - val_loss: 0.1128 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0874 - val_loss: 0.1222 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0899 - val_loss: 0.1270 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0918 - val_loss: 0.1233 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0949 - val_loss: 0.1046 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0900 - val_loss: 0.0960 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0859 - val_loss: 0.0883 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0827 - val_loss: 0.0871 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0810 - val_loss: 0.0834 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0791 - val_loss: 0.0822 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0793 - val_loss: 0.0803 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0778 - val_loss: 0.0796 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0771 - val_loss: 0.0793 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0758 - val_loss: 0.0787 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0773 - val_loss: 0.0784 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0762 - val_loss: 0.0784 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0757 - val_loss: 0.0784 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0756 - val_loss: 0.0781 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0762 - val_loss: 0.0780 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0760 - val_loss: 0.0779 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0756 - val_loss: 0.0779 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0754 - val_loss: 0.0779 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0752 - val_loss: 0.0779 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0753 - val_loss: 0.0780 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0758 - val_loss: 0.0780 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0748 - val_loss: 0.0779 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0756 - val_loss: 0.0779 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0756 - val_loss: 0.0779 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0750 - val_loss: 0.0779 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0754 - val_loss: 0.0779 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0753 - val_loss: 0.0779 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0747 - val_loss: 0.0779 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0758 - val_loss: 0.0779 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0748 - val_loss: 0.0779 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.0779 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0779 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0779 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0749 - val_loss: 0.0779 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0753 - val_loss: 0.0779 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0749 - val_loss: 0.0779 - lr: 1.3710e-09
Epoch 1/100
43/43 [==============================] - 5s 43ms/step - loss: 0.2166 - val_loss: 0.1927 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1780 - val_loss: 0.1676 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1607 - val_loss: 0.1575 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1382 - val_loss: 0.1429 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1300 - val_loss: 0.1380 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1227 - val_loss: 0.1315 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1106 - val_loss: 0.1252 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1052 - val_loss: 0.1200 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0993 - val_loss: 0.1149 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0962 - val_loss: 0.1126 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1036 - val_loss: 0.1150 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0987 - val_loss: 0.1084 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0928 - val_loss: 0.1061 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0897 - val_loss: 0.1031 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0855 - val_loss: 0.1009 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0819 - val_loss: 0.0985 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0785 - val_loss: 0.0961 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0747 - val_loss: 0.0932 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0742 - val_loss: 0.0905 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0716 - val_loss: 0.0892 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0701 - val_loss: 0.0879 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0683 - val_loss: 0.0869 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0668 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0654 - val_loss: 0.0844 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0648 - val_loss: 0.0829 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0638 - val_loss: 0.0824 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0643 - val_loss: 0.0821 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0645 - val_loss: 0.0816 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0647 - val_loss: 0.0801 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0639 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0640 - val_loss: 0.0785 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0636 - val_loss: 0.0780 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0629 - val_loss: 0.0780 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0779 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0630 - val_loss: 0.0779 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0623 - val_loss: 0.0777 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0618 - val_loss: 0.0777 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0620 - val_loss: 0.0777 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0623 - val_loss: 0.0777 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0613 - val_loss: 0.0776 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0614 - val_loss: 0.0776 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 2s 40ms/step - loss: 0.0622 - val_loss: 0.0776 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 2s 43ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0632 - val_loss: 0.0776 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0625 - val_loss: 0.0776 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0622 - val_loss: 0.0776 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0614 - val_loss: 0.0776 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0618 - val_loss: 0.0776 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0612 - val_loss: 0.0776 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0621 - val_loss: 0.0776 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0627 - val_loss: 0.0776 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0624 - val_loss: 0.0776 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 2s 42ms/step - loss: 0.0616 - val_loss: 0.0776 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0625 - val_loss: 0.0776 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0615 - val_loss: 0.0776 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0621 - val_loss: 0.0776 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0776 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0616 - val_loss: 0.0776 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0627 - val_loss: 0.0776 - lr: 2.2897e-14
Average Validation Loss: 0.09198872447013855
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 6s 333ms/step - loss: 0.3206 - val_loss: 0.2487 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 72ms/step - loss: 0.2163 - val_loss: 0.2454 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 50ms/step - loss: 0.2198 - val_loss: 0.2582 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 50ms/step - loss: 0.2229 - val_loss: 0.2514 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 42ms/step - loss: 0.2140 - val_loss: 0.2332 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 45ms/step - loss: 0.2038 - val_loss: 0.2168 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1943 - val_loss: 0.2104 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 54ms/step - loss: 0.1837 - val_loss: 0.2134 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1830 - val_loss: 0.2141 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1780 - val_loss: 0.2062 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 76ms/step - loss: 0.1707 - val_loss: 0.1963 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 72ms/step - loss: 0.1610 - val_loss: 0.1930 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 69ms/step - loss: 0.1508 - val_loss: 0.1843 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 59ms/step - loss: 0.1462 - val_loss: 0.1803 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 69ms/step - loss: 0.1407 - val_loss: 0.1891 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1416 - val_loss: 0.1716 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 61ms/step - loss: 0.1349 - val_loss: 0.1805 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1354 - val_loss: 0.1726 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1298 - val_loss: 0.1735 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1282 - val_loss: 0.1784 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 58ms/step - loss: 0.1279 - val_loss: 0.1743 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1263 - val_loss: 0.1728 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1257 - val_loss: 0.1720 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 63ms/step - loss: 0.1241 - val_loss: 0.1731 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 57ms/step - loss: 0.1237 - val_loss: 0.1724 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1250 - val_loss: 0.1705 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1227 - val_loss: 0.1697 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 68ms/step - loss: 0.1213 - val_loss: 0.1699 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1215 - val_loss: 0.1699 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 67ms/step - loss: 0.1217 - val_loss: 0.1705 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 54ms/step - loss: 0.1206 - val_loss: 0.1706 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 75ms/step - loss: 0.1209 - val_loss: 0.1699 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1221 - val_loss: 0.1693 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1211 - val_loss: 0.1691 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1207 - val_loss: 0.1691 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1206 - val_loss: 0.1692 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1208 - val_loss: 0.1691 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1218 - val_loss: 0.1691 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1229 - val_loss: 0.1691 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1222 - val_loss: 0.1691 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 56ms/step - loss: 0.1215 - val_loss: 0.1692 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1202 - val_loss: 0.1692 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1210 - val_loss: 0.1692 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1220 - val_loss: 0.1692 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1202 - val_loss: 0.1692 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1204 - val_loss: 0.1692 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1214 - val_loss: 0.1692 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 49ms/step - loss: 0.1212 - val_loss: 0.1692 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 49ms/step - loss: 0.1196 - val_loss: 0.1692 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 58ms/step - loss: 0.1206 - val_loss: 0.1692 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 54ms/step - loss: 0.1203 - val_loss: 0.1692 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1203 - val_loss: 0.1692 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1231 - val_loss: 0.1692 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1198 - val_loss: 0.1692 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1218 - val_loss: 0.1692 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1241 - val_loss: 0.1692 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1224 - val_loss: 0.1692 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 62ms/step - loss: 0.1225 - val_loss: 0.1692 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1201 - val_loss: 0.1692 - lr: 5.0435e-10
Epoch 1/100
9/9 [==============================] - 4s 142ms/step - loss: 0.2511 - val_loss: 0.1882 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 42ms/step - loss: 0.2289 - val_loss: 0.1777 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 34ms/step - loss: 0.2123 - val_loss: 0.1760 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1994 - val_loss: 0.1660 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1906 - val_loss: 0.1555 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1792 - val_loss: 0.1627 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1679 - val_loss: 0.1575 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1588 - val_loss: 0.1503 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1526 - val_loss: 0.1495 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1432 - val_loss: 0.1415 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1388 - val_loss: 0.1433 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1320 - val_loss: 0.1398 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 1s 61ms/step - loss: 0.1303 - val_loss: 0.1255 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1256 - val_loss: 0.1300 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1208 - val_loss: 0.1207 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 54ms/step - loss: 0.1178 - val_loss: 0.1187 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1151 - val_loss: 0.1175 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1110 - val_loss: 0.1125 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1093 - val_loss: 0.1117 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1077 - val_loss: 0.1093 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1059 - val_loss: 0.1116 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1039 - val_loss: 0.1066 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1035 - val_loss: 0.1066 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1023 - val_loss: 0.1049 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1021 - val_loss: 0.1049 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1015 - val_loss: 0.1061 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1010 - val_loss: 0.1075 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 52ms/step - loss: 0.1010 - val_loss: 0.1053 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 46ms/step - loss: 0.1010 - val_loss: 0.1048 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1006 - val_loss: 0.1057 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0995 - val_loss: 0.1043 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0998 - val_loss: 0.1037 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1004 - val_loss: 0.1042 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0998 - val_loss: 0.1044 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0996 - val_loss: 0.1047 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 49ms/step - loss: 0.0988 - val_loss: 0.1046 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 46ms/step - loss: 0.1002 - val_loss: 0.1046 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 48ms/step - loss: 0.0995 - val_loss: 0.1048 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 52ms/step - loss: 0.0989 - val_loss: 0.1048 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 54ms/step - loss: 0.0991 - val_loss: 0.1048 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 49ms/step - loss: 0.0993 - val_loss: 0.1048 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0996 - val_loss: 0.1048 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0996 - val_loss: 0.1048 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0994 - val_loss: 0.1048 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1000 - val_loss: 0.1048 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0993 - val_loss: 0.1048 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 48ms/step - loss: 0.0997 - val_loss: 0.1048 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1000 - val_loss: 0.1048 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0992 - val_loss: 0.1048 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0997 - val_loss: 0.1048 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0998 - val_loss: 0.1048 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0996 - val_loss: 0.1048 - lr: 1.6702e-08
Epoch 1/100
13/13 [==============================] - 5s 96ms/step - loss: 0.2693 - val_loss: 0.2221 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 33ms/step - loss: 0.2174 - val_loss: 0.2171 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 30ms/step - loss: 0.2011 - val_loss: 0.2051 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1820 - val_loss: 0.1797 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1714 - val_loss: 0.1573 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1592 - val_loss: 0.1400 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 34ms/step - loss: 0.1536 - val_loss: 0.1300 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 34ms/step - loss: 0.1447 - val_loss: 0.1285 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 36ms/step - loss: 0.1329 - val_loss: 0.1165 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 1s 44ms/step - loss: 0.1263 - val_loss: 0.1074 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 1s 44ms/step - loss: 0.1228 - val_loss: 0.1031 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 1s 38ms/step - loss: 0.1181 - val_loss: 0.1066 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 38ms/step - loss: 0.1111 - val_loss: 0.1046 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1084 - val_loss: 0.1033 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1032 - val_loss: 0.0967 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0999 - val_loss: 0.0930 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0994 - val_loss: 0.0926 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0980 - val_loss: 0.0978 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0963 - val_loss: 0.0928 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0937 - val_loss: 0.0886 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0925 - val_loss: 0.0901 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0909 - val_loss: 0.0878 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0906 - val_loss: 0.0875 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0892 - val_loss: 0.0869 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0886 - val_loss: 0.0887 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0885 - val_loss: 0.0843 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0882 - val_loss: 0.0875 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0882 - val_loss: 0.0850 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0889 - val_loss: 0.0853 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0877 - val_loss: 0.0855 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0876 - val_loss: 0.0858 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0868 - val_loss: 0.0856 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0871 - val_loss: 0.0855 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0874 - val_loss: 0.0859 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0881 - val_loss: 0.0856 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0870 - val_loss: 0.0853 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0866 - val_loss: 0.0853 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0859 - val_loss: 0.0853 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0866 - val_loss: 0.0854 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0873 - val_loss: 0.0854 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0877 - val_loss: 0.0854 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0872 - val_loss: 0.0854 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0878 - val_loss: 0.0854 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0875 - val_loss: 0.0854 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0870 - val_loss: 0.0855 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 47ms/step - loss: 0.0877 - val_loss: 0.0855 - lr: 2.2487e-07
Epoch 1/100
17/17 [==============================] - 5s 86ms/step - loss: 0.2339 - val_loss: 0.2107 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 33ms/step - loss: 0.2028 - val_loss: 0.2006 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1849 - val_loss: 0.1958 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1724 - val_loss: 0.1958 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1658 - val_loss: 0.1779 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1591 - val_loss: 0.1519 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1444 - val_loss: 0.1500 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1350 - val_loss: 0.1556 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1346 - val_loss: 0.1459 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1312 - val_loss: 0.1287 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1200 - val_loss: 0.1196 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1116 - val_loss: 0.1191 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1076 - val_loss: 0.1165 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1058 - val_loss: 0.1149 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1062 - val_loss: 0.1062 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1018 - val_loss: 0.1004 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0980 - val_loss: 0.0976 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0963 - val_loss: 0.0927 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0934 - val_loss: 0.0920 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0929 - val_loss: 0.0886 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0925 - val_loss: 0.0849 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0902 - val_loss: 0.0801 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0886 - val_loss: 0.0787 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0865 - val_loss: 0.0779 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0864 - val_loss: 0.0758 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0854 - val_loss: 0.0760 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0850 - val_loss: 0.0754 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0851 - val_loss: 0.0742 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0843 - val_loss: 0.0742 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0842 - val_loss: 0.0737 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0834 - val_loss: 0.0735 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0834 - val_loss: 0.0735 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0836 - val_loss: 0.0733 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0834 - val_loss: 0.0731 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0835 - val_loss: 0.0731 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0841 - val_loss: 0.0730 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0837 - val_loss: 0.0729 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0833 - val_loss: 0.0728 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 28ms/step - loss: 0.0831 - val_loss: 0.0728 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0839 - val_loss: 0.0728 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0831 - val_loss: 0.0728 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0838 - val_loss: 0.0727 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0840 - val_loss: 0.0727 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0832 - val_loss: 0.0727 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0835 - val_loss: 0.0727 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0837 - val_loss: 0.0727 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0839 - val_loss: 0.0727 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0843 - val_loss: 0.0727 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 54ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0835 - val_loss: 0.0727 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0840 - val_loss: 0.0727 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0826 - val_loss: 0.0727 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0842 - val_loss: 0.0727 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0841 - val_loss: 0.0727 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0839 - val_loss: 0.0727 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0832 - val_loss: 0.0727 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0838 - val_loss: 0.0727 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0826 - val_loss: 0.0727 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0837 - val_loss: 0.0727 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0840 - val_loss: 0.0727 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 2.2897e-14
Epoch 1/100
22/22 [==============================] - 5s 61ms/step - loss: 0.2268 - val_loss: 0.2045 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 27ms/step - loss: 0.2032 - val_loss: 0.1910 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1842 - val_loss: 0.1755 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1731 - val_loss: 0.1675 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1645 - val_loss: 0.1622 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1514 - val_loss: 0.1488 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 25ms/step - loss: 0.1406 - val_loss: 0.1384 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1335 - val_loss: 0.1368 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 30ms/step - loss: 0.1334 - val_loss: 0.1371 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 31ms/step - loss: 0.1274 - val_loss: 0.1335 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1223 - val_loss: 0.1313 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 33ms/step - loss: 0.1172 - val_loss: 0.1287 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1137 - val_loss: 0.1227 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1063 - val_loss: 0.1186 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1027 - val_loss: 0.1184 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1004 - val_loss: 0.1166 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0963 - val_loss: 0.1125 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0936 - val_loss: 0.1097 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 55ms/step - loss: 0.0907 - val_loss: 0.1071 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 2s 76ms/step - loss: 0.0876 - val_loss: 0.1038 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0848 - val_loss: 0.1003 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 45ms/step - loss: 0.0824 - val_loss: 0.0968 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0805 - val_loss: 0.0938 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0783 - val_loss: 0.0905 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0774 - val_loss: 0.0889 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 53ms/step - loss: 0.0757 - val_loss: 0.0880 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0755 - val_loss: 0.0875 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 2s 85ms/step - loss: 0.0747 - val_loss: 0.0869 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0738 - val_loss: 0.0868 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0740 - val_loss: 0.0863 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 45ms/step - loss: 0.0737 - val_loss: 0.0859 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0739 - val_loss: 0.0859 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0735 - val_loss: 0.0858 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0734 - val_loss: 0.0856 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0735 - val_loss: 0.0856 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 48ms/step - loss: 0.0736 - val_loss: 0.0855 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0732 - val_loss: 0.0854 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0738 - val_loss: 0.0854 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0741 - val_loss: 0.0854 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0732 - val_loss: 0.0854 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0738 - val_loss: 0.0854 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0732 - val_loss: 0.0854 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0736 - val_loss: 0.0854 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0737 - val_loss: 0.0854 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0738 - val_loss: 0.0854 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0739 - val_loss: 0.0853 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0733 - val_loss: 0.0853 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0733 - val_loss: 0.0853 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0731 - val_loss: 0.0853 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0730 - val_loss: 0.0853 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0744 - val_loss: 0.0853 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0739 - val_loss: 0.0853 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0745 - val_loss: 0.0853 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0733 - val_loss: 0.0853 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0736 - val_loss: 0.0853 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0732 - val_loss: 0.0853 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0729 - val_loss: 0.0853 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 56ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 52ms/step - loss: 0.0744 - val_loss: 0.0853 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 51ms/step - loss: 0.0735 - val_loss: 0.0853 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0741 - val_loss: 0.0853 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0741 - val_loss: 0.0853 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0736 - val_loss: 0.0853 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0740 - val_loss: 0.0853 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0731 - val_loss: 0.0853 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0741 - val_loss: 0.0853 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0735 - val_loss: 0.0853 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0732 - val_loss: 0.0853 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0727 - val_loss: 0.0853 - lr: 5.6464e-15
Average Validation Loss: 0.1030262440443039
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 7s 79ms/step - loss: 0.1120 - val_loss: 0.1848 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 24ms/step - loss: 0.1383 - val_loss: 0.1331 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1155 - val_loss: 0.1359 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1135 - val_loss: 0.1295 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1058 - val_loss: 0.1302 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0967 - val_loss: 0.1517 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1147 - val_loss: 0.1161 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0818 - val_loss: 0.1206 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0678 - val_loss: 0.1594 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0844 - val_loss: 0.1297 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0798 - val_loss: 0.1052 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0666 - val_loss: 0.1023 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0609 - val_loss: 0.1024 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 1s 35ms/step - loss: 0.0554 - val_loss: 0.1038 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 1s 48ms/step - loss: 0.0527 - val_loss: 0.1108 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 1s 65ms/step - loss: 0.0557 - val_loss: 0.0968 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 1s 47ms/step - loss: 0.0531 - val_loss: 0.1044 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 1s 53ms/step - loss: 0.0502 - val_loss: 0.0991 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 1s 47ms/step - loss: 0.0492 - val_loss: 0.1001 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 1s 64ms/step - loss: 0.0485 - val_loss: 0.0956 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 1s 55ms/step - loss: 0.0484 - val_loss: 0.1062 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 1s 53ms/step - loss: 0.0464 - val_loss: 0.1000 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 1s 47ms/step - loss: 0.0461 - val_loss: 0.0999 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0484 - val_loss: 0.1014 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 1s 42ms/step - loss: 0.0468 - val_loss: 0.0965 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 1s 37ms/step - loss: 0.0479 - val_loss: 0.0963 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 1s 54ms/step - loss: 0.0467 - val_loss: 0.0943 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0457 - val_loss: 0.0955 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 1s 34ms/step - loss: 0.0451 - val_loss: 0.0963 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0468 - val_loss: 0.0975 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 1s 36ms/step - loss: 0.0452 - val_loss: 0.0965 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0439 - val_loss: 0.0961 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0446 - val_loss: 0.0941 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0460 - val_loss: 0.0939 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0460 - val_loss: 0.0944 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0438 - val_loss: 0.0947 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0454 - val_loss: 0.0951 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0456 - val_loss: 0.0952 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0463 - val_loss: 0.0952 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0455 - val_loss: 0.0951 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0443 - val_loss: 0.0953 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0444 - val_loss: 0.0954 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0457 - val_loss: 0.0954 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0452 - val_loss: 0.0954 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0465 - val_loss: 0.0954 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0456 - val_loss: 0.0954 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0446 - val_loss: 0.0954 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0445 - val_loss: 0.0954 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0440 - val_loss: 0.0954 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0442 - val_loss: 0.0954 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0464 - val_loss: 0.0954 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0466 - val_loss: 0.0954 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0476 - val_loss: 0.0954 - lr: 1.0130e-08
Epoch 54/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0460 - val_loss: 0.0954 - lr: 6.1442e-09
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1461 - val_loss: 0.1080 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1351 - val_loss: 0.0780 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1286 - val_loss: 0.0936 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1224 - val_loss: 0.0689 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1213 - val_loss: 0.0809 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1161 - val_loss: 0.0666 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1102 - val_loss: 0.0791 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1052 - val_loss: 0.0675 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1076 - val_loss: 0.0789 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1000 - val_loss: 0.0788 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1000 - val_loss: 0.0635 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0921 - val_loss: 0.0891 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0837 - val_loss: 0.0951 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0844 - val_loss: 0.0652 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0854 - val_loss: 0.0630 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0768 - val_loss: 0.0648 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0720 - val_loss: 0.0595 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0672 - val_loss: 0.0621 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0620 - val_loss: 0.0641 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0623 - val_loss: 0.0608 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0579 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0584 - val_loss: 0.0589 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0551 - val_loss: 0.0591 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0547 - val_loss: 0.0613 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0536 - val_loss: 0.0665 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0522 - val_loss: 0.0650 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0518 - val_loss: 0.0645 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0505 - val_loss: 0.0635 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0517 - val_loss: 0.0656 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0508 - val_loss: 0.0669 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0509 - val_loss: 0.0659 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0505 - val_loss: 0.0668 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0499 - val_loss: 0.0664 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0496 - val_loss: 0.0669 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0500 - val_loss: 0.0675 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0498 - val_loss: 0.0676 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0501 - val_loss: 0.0676 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0502 - val_loss: 0.0675 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0499 - val_loss: 0.0673 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0487 - val_loss: 0.0673 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0497 - val_loss: 0.0673 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 6s 57ms/step - loss: 0.1302 - val_loss: 0.1176 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1189 - val_loss: 0.1099 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1151 - val_loss: 0.1058 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1105 - val_loss: 0.1035 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1083 - val_loss: 0.1018 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1042 - val_loss: 0.0966 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0998 - val_loss: 0.0983 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 23ms/step - loss: 0.1014 - val_loss: 0.0951 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0966 - val_loss: 0.0921 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0914 - val_loss: 0.0861 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0886 - val_loss: 0.0826 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0798 - val_loss: 0.0770 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0743 - val_loss: 0.0678 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0692 - val_loss: 0.0717 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0668 - val_loss: 0.0599 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0620 - val_loss: 0.0666 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0612 - val_loss: 0.0608 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0587 - val_loss: 0.0619 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0567 - val_loss: 0.0584 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0568 - val_loss: 0.0603 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0568 - val_loss: 0.0608 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0599 - val_loss: 0.0592 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0589 - val_loss: 0.0559 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0587 - val_loss: 0.0527 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0572 - val_loss: 0.0519 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0546 - val_loss: 0.0522 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0535 - val_loss: 0.0523 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0521 - val_loss: 0.0531 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0507 - val_loss: 0.0526 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0500 - val_loss: 0.0534 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0494 - val_loss: 0.0534 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0497 - val_loss: 0.0532 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0484 - val_loss: 0.0532 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0484 - val_loss: 0.0534 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0534 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0480 - val_loss: 0.0537 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0477 - val_loss: 0.0538 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0470 - val_loss: 0.0539 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0484 - val_loss: 0.0538 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0478 - val_loss: 0.0537 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0472 - val_loss: 0.0537 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0470 - val_loss: 0.0537 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0483 - val_loss: 0.0537 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0485 - val_loss: 0.0537 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 7s 43ms/step - loss: 0.1305 - val_loss: 0.1397 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1216 - val_loss: 0.1151 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 22ms/step - loss: 0.1123 - val_loss: 0.1129 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1062 - val_loss: 0.1000 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1014 - val_loss: 0.1030 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0980 - val_loss: 0.0923 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0894 - val_loss: 0.0849 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0857 - val_loss: 0.0848 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 3s 38ms/step - loss: 0.0815 - val_loss: 0.0857 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 3s 49ms/step - loss: 0.0761 - val_loss: 0.0859 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0692 - val_loss: 0.0695 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0638 - val_loss: 0.0695 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 3s 42ms/step - loss: 0.0610 - val_loss: 0.0730 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 3s 44ms/step - loss: 0.0591 - val_loss: 0.0656 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 3s 46ms/step - loss: 0.0583 - val_loss: 0.0622 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0547 - val_loss: 0.0616 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0543 - val_loss: 0.0625 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 2s 34ms/step - loss: 0.0534 - val_loss: 0.0600 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0512 - val_loss: 0.0593 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0511 - val_loss: 0.0610 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0493 - val_loss: 0.0606 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0495 - val_loss: 0.0608 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0478 - val_loss: 0.0583 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0485 - val_loss: 0.0574 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0483 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0469 - val_loss: 0.0516 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0478 - val_loss: 0.0504 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0475 - val_loss: 0.0491 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0466 - val_loss: 0.0485 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0455 - val_loss: 0.0482 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0446 - val_loss: 0.0480 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0449 - val_loss: 0.0479 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0449 - val_loss: 0.0478 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0445 - val_loss: 0.0477 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0442 - val_loss: 0.0476 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0443 - val_loss: 0.0476 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0435 - val_loss: 0.0476 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0453 - val_loss: 0.0476 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0476 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0437 - val_loss: 0.0475 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0432 - val_loss: 0.0475 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0437 - val_loss: 0.0475 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0439 - val_loss: 0.0475 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0433 - val_loss: 0.0475 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0450 - val_loss: 0.0475 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0443 - val_loss: 0.0475 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0447 - val_loss: 0.0475 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0451 - val_loss: 0.0475 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0475 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0475 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0475 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0443 - val_loss: 0.0475 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0439 - val_loss: 0.0475 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0443 - val_loss: 0.0475 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0441 - val_loss: 0.0475 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0475 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0437 - val_loss: 0.0475 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0475 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0433 - val_loss: 0.0475 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0475 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 1.1370e-14
Epoch 1/100
85/85 [==============================] - 6s 33ms/step - loss: 0.1284 - val_loss: 0.1113 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 25ms/step - loss: 0.1117 - val_loss: 0.1021 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 20ms/step - loss: 0.1004 - val_loss: 0.0939 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0941 - val_loss: 0.0893 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0891 - val_loss: 0.0912 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0839 - val_loss: 0.0833 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0790 - val_loss: 0.0758 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0699 - val_loss: 0.0751 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0697 - val_loss: 0.0692 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0649 - val_loss: 0.0692 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0640 - val_loss: 0.0662 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0587 - val_loss: 0.0700 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0600 - val_loss: 0.0672 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0562 - val_loss: 0.0690 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0549 - val_loss: 0.0680 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0531 - val_loss: 0.0674 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0546 - val_loss: 0.0642 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0516 - val_loss: 0.0625 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0495 - val_loss: 0.0591 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0480 - val_loss: 0.0590 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0470 - val_loss: 0.0577 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0451 - val_loss: 0.0565 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0433 - val_loss: 0.0545 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0416 - val_loss: 0.0529 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0410 - val_loss: 0.0529 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0401 - val_loss: 0.0524 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0393 - val_loss: 0.0523 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0391 - val_loss: 0.0519 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0392 - val_loss: 0.0513 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0395 - val_loss: 0.0513 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0392 - val_loss: 0.0507 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0386 - val_loss: 0.0501 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0394 - val_loss: 0.0500 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0386 - val_loss: 0.0500 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0377 - val_loss: 0.0500 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0377 - val_loss: 0.0500 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0381 - val_loss: 0.0499 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0386 - val_loss: 0.0499 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0390 - val_loss: 0.0499 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0384 - val_loss: 0.0499 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0377 - val_loss: 0.0499 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0383 - val_loss: 0.0499 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0382 - val_loss: 0.0499 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0382 - val_loss: 0.0499 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0379 - val_loss: 0.0499 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 29ms/step - loss: 0.0383 - val_loss: 0.0499 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 3s 31ms/step - loss: 0.0381 - val_loss: 0.0499 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0383 - val_loss: 0.0499 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0380 - val_loss: 0.0499 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0387 - val_loss: 0.0499 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0382 - val_loss: 0.0499 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0374 - val_loss: 0.0499 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0377 - val_loss: 0.0499 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0380 - val_loss: 0.0499 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0378 - val_loss: 0.0499 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0388 - val_loss: 0.0499 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0384 - val_loss: 0.0499 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0377 - val_loss: 0.0499 - lr: 8.3153e-10
Average Validation Loss: 0.06022659987211228
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 153ms/step - loss: 0.1540 - val_loss: 0.1452 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1234 - val_loss: 0.1525 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1227 - val_loss: 0.1320 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1101 - val_loss: 0.1246 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1013 - val_loss: 0.1269 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0989 - val_loss: 0.1219 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0886 - val_loss: 0.1191 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0784 - val_loss: 0.1105 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0676 - val_loss: 0.1127 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0654 - val_loss: 0.1034 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0616 - val_loss: 0.1025 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0557 - val_loss: 0.1152 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0542 - val_loss: 0.1140 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0542 - val_loss: 0.1127 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0520 - val_loss: 0.1064 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0511 - val_loss: 0.1038 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0505 - val_loss: 0.1139 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0541 - val_loss: 0.1007 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0493 - val_loss: 0.1162 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0526 - val_loss: 0.0986 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0491 - val_loss: 0.1127 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0479 - val_loss: 0.1014 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0492 - val_loss: 0.1099 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0502 - val_loss: 0.1053 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0489 - val_loss: 0.1016 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0484 - val_loss: 0.1043 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0478 - val_loss: 0.1047 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0477 - val_loss: 0.1042 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0483 - val_loss: 0.1032 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 1s 68ms/step - loss: 0.0476 - val_loss: 0.1035 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 52ms/step - loss: 0.0493 - val_loss: 0.1029 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 51ms/step - loss: 0.0486 - val_loss: 0.1026 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 52ms/step - loss: 0.0483 - val_loss: 0.1031 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0475 - val_loss: 0.1037 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0472 - val_loss: 0.1037 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0486 - val_loss: 0.1032 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0478 - val_loss: 0.1034 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0488 - val_loss: 0.1033 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0473 - val_loss: 0.1033 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 54ms/step - loss: 0.0481 - val_loss: 0.1033 - lr: 2.4788e-06
Epoch 1/100
17/17 [==============================] - 6s 76ms/step - loss: 0.1773 - val_loss: 0.0837 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1280 - val_loss: 0.0817 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1226 - val_loss: 0.0824 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1156 - val_loss: 0.0852 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1097 - val_loss: 0.0798 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1043 - val_loss: 0.0831 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0939 - val_loss: 0.0853 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0933 - val_loss: 0.0852 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0875 - val_loss: 0.0831 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0865 - val_loss: 0.0771 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0789 - val_loss: 0.0772 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0709 - val_loss: 0.0803 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0692 - val_loss: 0.0810 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0661 - val_loss: 0.0791 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0645 - val_loss: 0.0763 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0622 - val_loss: 0.0757 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0602 - val_loss: 0.0767 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0589 - val_loss: 0.0753 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0578 - val_loss: 0.0727 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0590 - val_loss: 0.0791 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0573 - val_loss: 0.0784 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0586 - val_loss: 0.0728 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0563 - val_loss: 0.0772 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0536 - val_loss: 0.0752 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0551 - val_loss: 0.0767 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0547 - val_loss: 0.0759 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0549 - val_loss: 0.0772 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0541 - val_loss: 0.0761 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0537 - val_loss: 0.0776 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0536 - val_loss: 0.0757 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0537 - val_loss: 0.0766 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0521 - val_loss: 0.0777 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0772 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0535 - val_loss: 0.0774 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0541 - val_loss: 0.0770 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0535 - val_loss: 0.0766 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0530 - val_loss: 0.0768 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0536 - val_loss: 0.0768 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0530 - val_loss: 0.0768 - lr: 3.3460e-06
Epoch 1/100
26/26 [==============================] - 7s 54ms/step - loss: 0.1287 - val_loss: 0.1207 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1153 - val_loss: 0.1003 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1091 - val_loss: 0.0917 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1034 - val_loss: 0.0849 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0957 - val_loss: 0.0820 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0944 - val_loss: 0.0798 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0908 - val_loss: 0.0777 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0839 - val_loss: 0.0717 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0798 - val_loss: 0.0648 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0733 - val_loss: 0.0602 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0728 - val_loss: 0.0628 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0697 - val_loss: 0.0566 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0681 - val_loss: 0.0610 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0696 - val_loss: 0.0589 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 33ms/step - loss: 0.0722 - val_loss: 0.0586 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0762 - val_loss: 0.0577 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0708 - val_loss: 0.0603 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0672 - val_loss: 0.0615 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0629 - val_loss: 0.0588 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0611 - val_loss: 0.0590 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0596 - val_loss: 0.0588 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0572 - val_loss: 0.0599 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0565 - val_loss: 0.0591 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0552 - val_loss: 0.0600 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0546 - val_loss: 0.0596 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0541 - val_loss: 0.0580 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0540 - val_loss: 0.0577 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0530 - val_loss: 0.0588 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0526 - val_loss: 0.0591 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0525 - val_loss: 0.0582 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0523 - val_loss: 0.0581 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0529 - val_loss: 0.0574 - lr: 2.7324e-05
Epoch 1/100
34/34 [==============================] - 5s 46ms/step - loss: 0.1254 - val_loss: 0.1225 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1108 - val_loss: 0.1145 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0993 - val_loss: 0.0970 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0951 - val_loss: 0.0846 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0891 - val_loss: 0.0862 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0827 - val_loss: 0.0742 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0734 - val_loss: 0.0717 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0709 - val_loss: 0.0694 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0671 - val_loss: 0.0691 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0714 - val_loss: 0.0704 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0664 - val_loss: 0.0671 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0650 - val_loss: 0.0592 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0572 - val_loss: 0.0582 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0590 - val_loss: 0.0553 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0554 - val_loss: 0.0524 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0555 - val_loss: 0.0523 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0531 - val_loss: 0.0505 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 43ms/step - loss: 0.0527 - val_loss: 0.0508 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0513 - val_loss: 0.0480 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0488 - val_loss: 0.0470 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0495 - val_loss: 0.0475 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0477 - val_loss: 0.0472 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0475 - val_loss: 0.0473 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0478 - val_loss: 0.0545 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0492 - val_loss: 0.0506 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0494 - val_loss: 0.0524 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0521 - val_loss: 0.0455 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0505 - val_loss: 0.0419 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0492 - val_loss: 0.0414 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0474 - val_loss: 0.0411 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 37ms/step - loss: 0.0473 - val_loss: 0.0415 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0462 - val_loss: 0.0415 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 2s 44ms/step - loss: 0.0458 - val_loss: 0.0414 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 43ms/step - loss: 0.0454 - val_loss: 0.0410 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0448 - val_loss: 0.0411 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0455 - val_loss: 0.0412 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0442 - val_loss: 0.0411 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0450 - val_loss: 0.0411 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 44ms/step - loss: 0.0453 - val_loss: 0.0411 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 44ms/step - loss: 0.0444 - val_loss: 0.0410 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 42ms/step - loss: 0.0443 - val_loss: 0.0410 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0456 - val_loss: 0.0410 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 43ms/step - loss: 0.0456 - val_loss: 0.0410 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0446 - val_loss: 0.0410 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 37ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 44ms/step - loss: 0.0452 - val_loss: 0.0410 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0459 - val_loss: 0.0410 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 42ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 37ms/step - loss: 0.0450 - val_loss: 0.0410 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 2s 50ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0452 - val_loss: 0.0410 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 2s 52ms/step - loss: 0.0447 - val_loss: 0.0410 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 2s 49ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 42ms/step - loss: 0.0452 - val_loss: 0.0410 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0455 - val_loss: 0.0410 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0449 - val_loss: 0.0410 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0453 - val_loss: 0.0410 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0458 - val_loss: 0.0410 - lr: 5.0565e-11
Epoch 1/100
43/43 [==============================] - 15s 103ms/step - loss: 0.1310 - val_loss: 0.1131 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 2s 42ms/step - loss: 0.1066 - val_loss: 0.1019 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 2s 47ms/step - loss: 0.0970 - val_loss: 0.0966 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0898 - val_loss: 0.0948 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 2s 49ms/step - loss: 0.0843 - val_loss: 0.0903 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 2s 49ms/step - loss: 0.0770 - val_loss: 0.0877 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 2s 43ms/step - loss: 0.0712 - val_loss: 0.0841 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 2s 46ms/step - loss: 0.0761 - val_loss: 0.0830 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0677 - val_loss: 0.0807 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 2s 49ms/step - loss: 0.0653 - val_loss: 0.0798 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 2s 48ms/step - loss: 0.0688 - val_loss: 0.0779 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 2s 36ms/step - loss: 0.0640 - val_loss: 0.0770 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 2s 42ms/step - loss: 0.0643 - val_loss: 0.0746 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0633 - val_loss: 0.0756 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 35ms/step - loss: 0.0588 - val_loss: 0.0769 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 35ms/step - loss: 0.0566 - val_loss: 0.0763 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0543 - val_loss: 0.0752 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 2s 43ms/step - loss: 0.0528 - val_loss: 0.0735 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 2s 47ms/step - loss: 0.0522 - val_loss: 0.0727 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0496 - val_loss: 0.0706 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0491 - val_loss: 0.0707 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0488 - val_loss: 0.0689 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0484 - val_loss: 0.0692 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0466 - val_loss: 0.0680 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0464 - val_loss: 0.0668 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0467 - val_loss: 0.0671 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0461 - val_loss: 0.0664 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0660 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0459 - val_loss: 0.0653 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0454 - val_loss: 0.0644 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0452 - val_loss: 0.0636 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0632 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0445 - val_loss: 0.0629 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0627 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0449 - val_loss: 0.0627 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0437 - val_loss: 0.0626 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0448 - val_loss: 0.0625 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0436 - val_loss: 0.0625 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0625 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0444 - val_loss: 0.0625 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0438 - val_loss: 0.0624 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0432 - val_loss: 0.0624 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0624 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0435 - val_loss: 0.0624 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0624 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0447 - val_loss: 0.0624 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0624 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0450 - val_loss: 0.0624 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0443 - val_loss: 0.0624 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0624 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0624 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0445 - val_loss: 0.0624 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0624 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0432 - val_loss: 0.0624 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0443 - val_loss: 0.0624 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0624 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0624 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0624 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0435 - val_loss: 0.0624 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0445 - val_loss: 0.0624 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0451 - val_loss: 0.0624 - lr: 4.6110e-14
Average Validation Loss: 0.06625610888004303
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 8s 284ms/step - loss: 0.2034 - val_loss: 0.1508 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1242 - val_loss: 0.1455 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1166 - val_loss: 0.1580 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1284 - val_loss: 0.1627 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1277 - val_loss: 0.1578 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1217 - val_loss: 0.1489 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1158 - val_loss: 0.1401 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1131 - val_loss: 0.1357 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1091 - val_loss: 0.1353 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1051 - val_loss: 0.1351 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1002 - val_loss: 0.1355 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0957 - val_loss: 0.1333 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0906 - val_loss: 0.1305 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0897 - val_loss: 0.1303 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0820 - val_loss: 0.1265 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0781 - val_loss: 0.1203 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0707 - val_loss: 0.1262 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0703 - val_loss: 0.1249 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0694 - val_loss: 0.1224 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0688 - val_loss: 0.1200 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0661 - val_loss: 0.1187 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0643 - val_loss: 0.1223 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0649 - val_loss: 0.1202 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0641 - val_loss: 0.1144 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 52ms/step - loss: 0.0619 - val_loss: 0.1157 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0631 - val_loss: 0.1187 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0628 - val_loss: 0.1202 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0635 - val_loss: 0.1211 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0610 - val_loss: 0.1218 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0603 - val_loss: 0.1209 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0588 - val_loss: 0.1197 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0597 - val_loss: 0.1197 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0581 - val_loss: 0.1201 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0597 - val_loss: 0.1202 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0593 - val_loss: 0.1201 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0622 - val_loss: 0.1200 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0602 - val_loss: 0.1199 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0609 - val_loss: 0.1198 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0617 - val_loss: 0.1198 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0576 - val_loss: 0.1197 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0612 - val_loss: 0.1197 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0591 - val_loss: 0.1196 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0607 - val_loss: 0.1196 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0593 - val_loss: 0.1195 - lr: 5.0045e-07
Epoch 1/100
9/9 [==============================] - 4s 122ms/step - loss: 0.1731 - val_loss: 0.0990 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1354 - val_loss: 0.0891 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1240 - val_loss: 0.0881 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1165 - val_loss: 0.0759 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1088 - val_loss: 0.0827 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0999 - val_loss: 0.0834 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1001 - val_loss: 0.0775 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0911 - val_loss: 0.0854 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0882 - val_loss: 0.0840 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0850 - val_loss: 0.0820 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0799 - val_loss: 0.0869 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0784 - val_loss: 0.0792 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0758 - val_loss: 0.0799 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0745 - val_loss: 0.0750 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0699 - val_loss: 0.0774 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0696 - val_loss: 0.0828 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0687 - val_loss: 0.0683 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0681 - val_loss: 0.0704 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0652 - val_loss: 0.0772 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0663 - val_loss: 0.0661 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0641 - val_loss: 0.0691 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0639 - val_loss: 0.0644 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0617 - val_loss: 0.0673 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0607 - val_loss: 0.0700 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0630 - val_loss: 0.0618 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0611 - val_loss: 0.0657 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0601 - val_loss: 0.0644 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0599 - val_loss: 0.0655 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0591 - val_loss: 0.0665 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0599 - val_loss: 0.0637 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0585 - val_loss: 0.0638 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0603 - val_loss: 0.0637 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0597 - val_loss: 0.0633 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0588 - val_loss: 0.0638 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0592 - val_loss: 0.0641 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0598 - val_loss: 0.0641 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0586 - val_loss: 0.0643 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0595 - val_loss: 0.0642 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0595 - val_loss: 0.0643 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0581 - val_loss: 0.0643 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0590 - val_loss: 0.0642 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0584 - val_loss: 0.0641 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0597 - val_loss: 0.0641 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0593 - val_loss: 0.0641 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0602 - val_loss: 0.0641 - lr: 3.3546e-07
Epoch 1/100
13/13 [==============================] - 4s 86ms/step - loss: 0.1424 - val_loss: 0.1228 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1165 - val_loss: 0.1189 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1063 - val_loss: 0.1006 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1012 - val_loss: 0.0853 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0973 - val_loss: 0.0793 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0927 - val_loss: 0.0783 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0866 - val_loss: 0.0716 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0811 - val_loss: 0.0699 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0804 - val_loss: 0.0704 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0870 - val_loss: 0.0723 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0771 - val_loss: 0.0715 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0710 - val_loss: 0.0620 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0669 - val_loss: 0.0601 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0661 - val_loss: 0.0596 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0710 - val_loss: 0.0577 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0711 - val_loss: 0.0693 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0653 - val_loss: 0.0700 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0590 - val_loss: 0.0581 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0593 - val_loss: 0.0555 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0576 - val_loss: 0.0576 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0561 - val_loss: 0.0550 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0568 - val_loss: 0.0576 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0553 - val_loss: 0.0623 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0525 - val_loss: 0.0554 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0543 - val_loss: 0.0601 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0536 - val_loss: 0.0580 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0526 - val_loss: 0.0577 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0539 - val_loss: 0.0561 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0541 - val_loss: 0.0569 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0525 - val_loss: 0.0564 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0528 - val_loss: 0.0570 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0528 - val_loss: 0.0577 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0532 - val_loss: 0.0573 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0525 - val_loss: 0.0576 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0528 - val_loss: 0.0574 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0524 - val_loss: 0.0574 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0537 - val_loss: 0.0576 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0533 - val_loss: 0.0578 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0528 - val_loss: 0.0578 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0534 - val_loss: 0.0577 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0539 - val_loss: 0.0576 - lr: 1.6616e-06
Epoch 1/100
17/17 [==============================] - 6s 126ms/step - loss: 0.1394 - val_loss: 0.1226 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1191 - val_loss: 0.1143 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1061 - val_loss: 0.1168 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1016 - val_loss: 0.1359 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1038 - val_loss: 0.1322 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1052 - val_loss: 0.0944 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0894 - val_loss: 0.1014 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0848 - val_loss: 0.1175 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0833 - val_loss: 0.1148 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0823 - val_loss: 0.1214 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0909 - val_loss: 0.1081 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0907 - val_loss: 0.0669 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0697 - val_loss: 0.0646 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0656 - val_loss: 0.0780 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0638 - val_loss: 0.0752 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0639 - val_loss: 0.0797 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0648 - val_loss: 0.0702 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0645 - val_loss: 0.0674 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0654 - val_loss: 0.0565 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0621 - val_loss: 0.0456 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0582 - val_loss: 0.0412 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0559 - val_loss: 0.0422 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0529 - val_loss: 0.0402 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0527 - val_loss: 0.0393 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0529 - val_loss: 0.0392 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0518 - val_loss: 0.0396 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0527 - val_loss: 0.0393 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0521 - val_loss: 0.0390 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0510 - val_loss: 0.0390 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0506 - val_loss: 0.0390 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0388 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0503 - val_loss: 0.0387 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0511 - val_loss: 0.0388 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0505 - val_loss: 0.0388 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0518 - val_loss: 0.0387 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0511 - val_loss: 0.0386 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0500 - val_loss: 0.0386 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0508 - val_loss: 0.0386 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0507 - val_loss: 0.0386 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0512 - val_loss: 0.0386 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0508 - val_loss: 0.0386 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0513 - val_loss: 0.0386 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0505 - val_loss: 0.0386 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0512 - val_loss: 0.0386 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0514 - val_loss: 0.0386 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0500 - val_loss: 0.0386 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0501 - val_loss: 0.0386 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0512 - val_loss: 0.0386 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0500 - val_loss: 0.0386 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0504 - val_loss: 0.0386 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 1s 80ms/step - loss: 0.0507 - val_loss: 0.0386 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 1s 69ms/step - loss: 0.0505 - val_loss: 0.0386 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 2s 89ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 2s 141ms/step - loss: 0.0511 - val_loss: 0.0386 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 2s 125ms/step - loss: 0.0516 - val_loss: 0.0386 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 2s 118ms/step - loss: 0.0499 - val_loss: 0.0386 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 2s 102ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 1s 71ms/step - loss: 0.0505 - val_loss: 0.0386 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 71ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 59ms/step - loss: 0.0508 - val_loss: 0.0386 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 1s 72ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 4.6110e-14
Epoch 1/100
22/22 [==============================] - 5s 69ms/step - loss: 0.1646 - val_loss: 0.1242 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1304 - val_loss: 0.1161 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1114 - val_loss: 0.1132 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1081 - val_loss: 0.1113 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1081 - val_loss: 0.1136 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1049 - val_loss: 0.1085 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0988 - val_loss: 0.1063 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0974 - val_loss: 0.1076 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0966 - val_loss: 0.1046 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0924 - val_loss: 0.1033 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0897 - val_loss: 0.1025 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0848 - val_loss: 0.1002 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0826 - val_loss: 0.0992 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0784 - val_loss: 0.0974 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0766 - val_loss: 0.0961 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0724 - val_loss: 0.0931 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0699 - val_loss: 0.0924 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0681 - val_loss: 0.0907 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0669 - val_loss: 0.0876 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0644 - val_loss: 0.0847 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0614 - val_loss: 0.0798 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0586 - val_loss: 0.0752 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0561 - val_loss: 0.0708 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0537 - val_loss: 0.0690 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0521 - val_loss: 0.0680 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0529 - val_loss: 0.0677 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0666 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0524 - val_loss: 0.0662 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0514 - val_loss: 0.0659 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0655 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0513 - val_loss: 0.0654 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0511 - val_loss: 0.0655 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0508 - val_loss: 0.0655 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0515 - val_loss: 0.0656 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0511 - val_loss: 0.0654 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0500 - val_loss: 0.0653 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0507 - val_loss: 0.0653 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0505 - val_loss: 0.0653 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0508 - val_loss: 0.0653 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0653 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0513 - val_loss: 0.0653 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0510 - val_loss: 0.0653 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0506 - val_loss: 0.0653 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0509 - val_loss: 0.0653 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0504 - val_loss: 0.0653 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0507 - val_loss: 0.0653 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0504 - val_loss: 0.0653 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0498 - val_loss: 0.0653 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0508 - val_loss: 0.0653 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0510 - val_loss: 0.0653 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0502 - val_loss: 0.0653 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0504 - val_loss: 0.0653 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0500 - val_loss: 0.0653 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0510 - val_loss: 0.0653 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0500 - val_loss: 0.0653 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0508 - val_loss: 0.0653 - lr: 3.0590e-10
Average Validation Loss: 0.06702316775918007
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 71ms/step - loss: 0.1004 - val_loss: 0.1655 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1237 - val_loss: 0.1229 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1076 - val_loss: 0.1147 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0953 - val_loss: 0.1143 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0869 - val_loss: 0.1189 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0672 - val_loss: 0.1385 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0720 - val_loss: 0.1102 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0559 - val_loss: 0.1020 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0551 - val_loss: 0.1061 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0563 - val_loss: 0.1051 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0624 - val_loss: 0.0976 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0632 - val_loss: 0.1131 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0603 - val_loss: 0.1033 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0474 - val_loss: 0.0929 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0493 - val_loss: 0.0995 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0439 - val_loss: 0.1053 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 1s 32ms/step - loss: 0.0424 - val_loss: 0.1026 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0422 - val_loss: 0.0954 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0420 - val_loss: 0.0992 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0415 - val_loss: 0.0927 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0385 - val_loss: 0.0993 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0408 - val_loss: 0.0977 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0400 - val_loss: 0.0923 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0401 - val_loss: 0.0964 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0372 - val_loss: 0.0972 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0372 - val_loss: 0.0932 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0366 - val_loss: 0.0961 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0393 - val_loss: 0.0938 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0369 - val_loss: 0.0959 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0384 - val_loss: 0.0953 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0395 - val_loss: 0.0923 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 44ms/step - loss: 0.0380 - val_loss: 0.0926 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0376 - val_loss: 0.0933 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0384 - val_loss: 0.0938 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0370 - val_loss: 0.0941 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0376 - val_loss: 0.0941 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0388 - val_loss: 0.0940 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0374 - val_loss: 0.0936 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0387 - val_loss: 0.0933 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0375 - val_loss: 0.0934 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0372 - val_loss: 0.0934 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0373 - val_loss: 0.0935 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0376 - val_loss: 0.0935 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0380 - val_loss: 0.0936 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0373 - val_loss: 0.0936 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0382 - val_loss: 0.0936 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.0936 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0381 - val_loss: 0.0936 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.0936 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0375 - val_loss: 0.0936 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0371 - val_loss: 0.0936 - lr: 2.7536e-08
Epoch 1/100
34/34 [==============================] - 4s 39ms/step - loss: 0.1407 - val_loss: 0.0842 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1275 - val_loss: 0.0795 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1171 - val_loss: 0.0760 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1189 - val_loss: 0.0724 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1146 - val_loss: 0.0791 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1123 - val_loss: 0.0649 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 29ms/step - loss: 0.1042 - val_loss: 0.0859 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1040 - val_loss: 0.0594 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1043 - val_loss: 0.0777 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0989 - val_loss: 0.0629 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0944 - val_loss: 0.0838 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0875 - val_loss: 0.0697 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0833 - val_loss: 0.0786 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0785 - val_loss: 0.0741 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0756 - val_loss: 0.0766 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0700 - val_loss: 0.0695 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0691 - val_loss: 0.0629 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0655 - val_loss: 0.0573 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0633 - val_loss: 0.0589 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0577 - val_loss: 0.0614 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0529 - val_loss: 0.0583 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0514 - val_loss: 0.0620 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0491 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0484 - val_loss: 0.0673 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0469 - val_loss: 0.0651 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0470 - val_loss: 0.0639 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0468 - val_loss: 0.0640 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0453 - val_loss: 0.0660 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0666 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0455 - val_loss: 0.0653 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0457 - val_loss: 0.0655 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0451 - val_loss: 0.0660 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0443 - val_loss: 0.0652 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0443 - val_loss: 0.0656 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0446 - val_loss: 0.0668 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0443 - val_loss: 0.0667 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0443 - val_loss: 0.0661 - lr: 6.0967e-06
Epoch 38/100
 5/34 [===>..........................] - ETA: 0s - loss: 0.0299
KeyboardInterrupt: 
Code
# Generate predictions
train_pred = model_final.predict(X_train).flatten()  # Flatten to ensure it's a 1D array
test_pred = model_final.predict(X_test).flatten()

# Create DataFrames for the actual and predicted values with proper indexing
train_indices = [x[0] for x in train_series]
train_gt = pd.DataFrame(y_train, columns=['y'], index=train_indices)
train_pred_df = pd.DataFrame(train_pred, columns=['yhat'], index=train_indices)

# Plot training predictions and actual values
pd.concat([train_gt, train_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Training Data: Actual vs Predicted')

# Ensure the index is constructed correctly 
test_indices = [x[0] for x in test_series]
test_gt = pd.DataFrame(y_test, columns=['y'], index=test_indices)
test_pred_df = pd.DataFrame(test_pred, columns=['yhat'], index=test_indices)

# Plot test predictions and actual values
pd.concat([test_gt, test_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Test Data: Actual vs Predicted')
plt.show()
102/102 [==============================] - 0s 1ms/step
34/34 [==============================] - 0s 900us/step

Code
# Initialize a list to store RMSEs for each fold
cv_rmses = []

# Cross-Validation Loop
for train_index, val_index in tscv.split(X_train):
    X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
    y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

    # Define and compile the LSTM model
    model = build_model(input_shape, output_units=1, neurons=best_config['neurons'], dropout=best_config['dropout'], l1_reg=best_config['l1_reg'], l2_reg=best_config['l2_reg'])
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')

    # Fit the model on this fold
    model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=best_config['batch_size'], validation_data=(X_val_fold, y_val_fold), shuffle=False, callbacks=[lr_schedule, early_stopping])

    # Make predictions on the validation fold and calculate RMSE
    val_pred = model.predict(X_val_fold).flatten()
    val_rmse = np.sqrt(mean_squared_error(y_val_fold, val_pred))
    cv_rmses.append(val_rmse)

# Calculate the average cross-validated RMSE
cv_rmse = np.mean(cv_rmses)
print(f"Cross-validated RMSE: {cv_rmse}")
Epoch 1/100
2023-11-26 18:56:55.127795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:55.128341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:55.128805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:55.191810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:55.192173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:55.192522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:55.276975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:55.277488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:55.277932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:55.336744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:55.337371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:55.337852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:55.597977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:55.598453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:55.598946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:55.660833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:55.661357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:55.661852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 1s 19ms/step - loss: 0.0981 - val_loss: 0.1581 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1395
2023-11-26 18:56:56.296252: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:56.296928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:56.297258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:56.359194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:56.359638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:56.360004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
18/18 [==============================] - 0s 5ms/step - loss: 0.1180 - val_loss: 0.1157 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.1192 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.1325 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.1020 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.1118 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.1238 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.1107 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.1251 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0541 - val_loss: 0.1379 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.1244 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.1371 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.1173 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0901 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0929 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.1065 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0938 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0822 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0912 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0998 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0914 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0387 - val_loss: 0.0886 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0388 - val_loss: 0.0958 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0380 - val_loss: 0.0873 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0379 - val_loss: 0.0878 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0359 - val_loss: 0.0922 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 6ms/step - loss: 0.0375 - val_loss: 0.0857 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0364 - val_loss: 0.0927 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0356 - val_loss: 0.0923 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0913 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0353 - val_loss: 0.0916 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0366 - val_loss: 0.0897 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0352 - val_loss: 0.0904 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0369 - val_loss: 0.0902 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0359 - val_loss: 0.0895 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0894 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0897 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0361 - val_loss: 0.0894 - lr: 4.5166e-06
17/17 [==============================] - 0s 1ms/step
2023-11-26 18:56:59.569950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:59.570418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:59.571013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:59.628136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:59.628512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:59.628908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
Epoch 1/100
2023-11-26 18:56:59.779180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:59.779805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:59.780221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:59.833350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:59.833781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:59.834150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:59.909819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:59.910299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:59.910700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:56:59.968748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:56:59.969146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:56:59.969650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:00.160234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:00.160831: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:00.161624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:00.226870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:00.227385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:00.227826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 1s 10ms/step - loss: 0.1370 - val_loss: 0.0812 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0548
2023-11-26 18:57:00.726599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:00.727086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:00.727787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:00.790755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:00.791248: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:00.791654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
34/34 [==============================] - 0s 3ms/step - loss: 0.1270 - val_loss: 0.0718 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1181 - val_loss: 0.0707 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1163 - val_loss: 0.0695 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1129 - val_loss: 0.0692 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1127 - val_loss: 0.0660 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1081 - val_loss: 0.0781 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1077 - val_loss: 0.0601 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1054 - val_loss: 0.0850 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0983 - val_loss: 0.0582 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0980 - val_loss: 0.0839 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0881 - val_loss: 0.0575 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0884 - val_loss: 0.0769 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0780 - val_loss: 0.0603 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0716 - val_loss: 0.0812 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0598 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0662 - val_loss: 0.0679 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0653 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0651 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0541 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0586 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0588 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0590 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0647 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0606 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0601 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0626 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0631 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0627 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0623 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0625 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0638 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0627 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0630 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0424 - val_loss: 0.0622 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0624 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0424 - val_loss: 0.0621 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0623 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0624 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0432 - val_loss: 0.0625 - lr: 2.4788e-06
17/17 [==============================] - 0s 1ms/step
2023-11-26 18:57:04.983630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:04.984094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:04.984582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:05.041352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:05.042151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:05.042570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
Epoch 1/100
2023-11-26 18:57:05.204881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:05.205552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:05.205866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:05.259949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:05.260351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:05.260705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:05.340580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:05.341040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:05.341458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:05.400382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:05.400935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:05.401302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:05.640176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:05.640657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:05.641205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:05.698772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:05.699226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:05.699624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.1170 - val_loss: 0.1069 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0940
2023-11-26 18:57:06.428045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:06.428502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:06.429109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:06.491188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:06.491608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:06.491996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 4ms/step - loss: 0.1081 - val_loss: 0.0976 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1032 - val_loss: 0.0951 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1022 - val_loss: 0.0930 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1002 - val_loss: 0.0899 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0962 - val_loss: 0.0895 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0959 - val_loss: 0.0884 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0884 - val_loss: 0.0820 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0939 - val_loss: 0.0901 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0911 - val_loss: 0.0825 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0819 - val_loss: 0.0769 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0758 - val_loss: 0.0701 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0714 - val_loss: 0.0612 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0611 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0608 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0604 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0570 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0555 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0541 - val_loss: 0.0557 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0572 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0564 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0494 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0484 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0483 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0483 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0478 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0479 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0485 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0482 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0487 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0490 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0491 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0489 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0487 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0486 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0487 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0489 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0490 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0490 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0489 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0489 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0489 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0489 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0489 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0489 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0489 - lr: 2.2487e-07
17/17 [==============================] - 0s 1ms/step
2023-11-26 18:57:14.704624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:14.705127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:14.705685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:14.763843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:14.764215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:14.764553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
Epoch 1/100
2023-11-26 18:57:14.926312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:14.926747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:14.927334: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:14.981795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:14.982187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:14.982548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:15.064437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:15.064920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:15.065363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:15.125377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:15.125842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:15.126267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:15.364702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:15.365156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:15.365722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:15.424439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:15.424912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:15.425347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 1s 7ms/step - loss: 0.1144 - val_loss: 0.1105 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1125
2023-11-26 18:57:16.215688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:16.216155: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:16.216659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:16.278609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:16.279049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:16.279463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
68/68 [==============================] - 0s 4ms/step - loss: 0.1044 - val_loss: 0.1057 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1015 - val_loss: 0.0996 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0955 - val_loss: 0.0898 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0873 - val_loss: 0.0870 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0842 - val_loss: 0.0843 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0746 - val_loss: 0.1060 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0730 - val_loss: 0.1072 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.1043 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.1220 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0840 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0797 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0746 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0696 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0652 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0510 - val_loss: 0.0651 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0652 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0656 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0650 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0662 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0686 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0685 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0672 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0688 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0661 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0638 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0614 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0595 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0586 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0575 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0567 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0566 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0425 - val_loss: 0.0565 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0563 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0562 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0427 - val_loss: 0.0561 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0561 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0561 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0418 - val_loss: 0.0560 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0560 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0560 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0560 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0560 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0421 - val_loss: 0.0560 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0424 - val_loss: 0.0559 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0559 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0559 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0559 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0559 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0559 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0559 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0559 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0416 - val_loss: 0.0559 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0559 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0559 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0425 - val_loss: 0.0559 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0559 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0559 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0559 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0412 - val_loss: 0.0559 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0559 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0559 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0415 - val_loss: 0.0559 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0412 - val_loss: 0.0559 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0559 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0559 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0418 - val_loss: 0.0559 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0559 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0559 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0559 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0559 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0417 - val_loss: 0.0559 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0559 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0559 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0428 - val_loss: 0.0559 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0559 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0559 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0559 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0559 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0417 - val_loss: 0.0559 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0422 - val_loss: 0.0559 - lr: 3.1068e-16
Epoch 82/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0422 - val_loss: 0.0559 - lr: 1.3960e-16
Epoch 83/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0559 - lr: 6.2726e-17
17/17 [==============================] - 0s 1ms/step
2023-11-26 18:57:35.367530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:35.367944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:35.368357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:35.425827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:35.426379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:35.426894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
Epoch 1/100
2023-11-26 18:57:35.578476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:35.579086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:35.579568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:35.631630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:35.632011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:35.632359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:35.715009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:35.715461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:35.715884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:35.774509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:35.774950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:35.775359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:36.433346: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:36.433804: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:36.434426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:36.492592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:36.493043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:36.493487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 2s 7ms/step - loss: 0.1233 - val_loss: 0.1048 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0584
2023-11-26 18:57:37.322901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:37.323441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:37.324009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:57:37.387053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:57:37.387494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:57:37.387888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
85/85 [==============================] - 0s 3ms/step - loss: 0.1092 - val_loss: 0.1001 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1030 - val_loss: 0.0981 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0976 - val_loss: 0.0958 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0932 - val_loss: 0.0944 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0895 - val_loss: 0.0925 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0879 - val_loss: 0.0920 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0841 - val_loss: 0.0906 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0883 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0751 - val_loss: 0.0859 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0755 - val_loss: 0.0855 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0706 - val_loss: 0.0848 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0829 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0816 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0809 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0804 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0787 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0772 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0762 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0751 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0752 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0735 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0729 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0728 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0421 - val_loss: 0.0720 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0412 - val_loss: 0.0711 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0411 - val_loss: 0.0706 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0410 - val_loss: 0.0700 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0691 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0400 - val_loss: 0.0688 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0400 - val_loss: 0.0678 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0399 - val_loss: 0.0674 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0394 - val_loss: 0.0669 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0385 - val_loss: 0.0666 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0663 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0661 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0386 - val_loss: 0.0660 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0384 - val_loss: 0.0659 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0659 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0658 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0658 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0658 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0658 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0657 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0657 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0657 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0657 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0657 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0657 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0657 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0657 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.0657 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0384 - val_loss: 0.0657 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0657 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.0657 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0657 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0384 - val_loss: 0.0657 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0657 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0382 - val_loss: 0.0657 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0657 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0657 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0657 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0657 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0657 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0657 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0657 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0383 - val_loss: 0.0657 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0657 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0657 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0657 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0657 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0657 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0657 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0657 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 3.1068e-16
Epoch 82/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 1.3960e-16
Epoch 83/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0657 - lr: 6.2726e-17
Epoch 84/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0657 - lr: 2.8185e-17
17/17 [==============================] - 0s 1ms/step
Cross-validated RMSE: 0.07087241651942167
2023-11-26 18:58:01.814577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:58:01.815040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:58:01.815725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 18:58:01.873366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 18:58:01.873746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 18:58:01.874135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

1.4 IV. Results

1.4.1 A. Model Performance Comparison

ARIMA (Autoregressive Integrated Moving Average) - Train RMSE: 0.012904220149601586 - Test RMSE: 0.0016051827138580381 - Average CV RMSE: 0.005935648933608896

Auto_arima - Train RMSE: 0.016412036571477613 - Test RMSE: 0.0035731612930503405 - Average CV RMSE: 0.020359403573376327

Univariate Prophet - Train RMSE: 0.0020426166695390077 - Test RMSE: 0.026674654082599218 - Average CV RMSE: 0.0086679294975011

Multivariate Prophet - Train RMSE: 0.01029038815089332 - Test RMSE: 0.012984771707713526 - Cross-validated RMSE: 0.011242406258430045

XGBoost - Train RMSE: 0.0012672636322900329 - Test RMSE: 0.08596906481390161 - Cross-validated RMSE: 0.06388431417642502

Keras LSTM (Long Short-Term Memory) - Train RMSE: 0.030340060238547382 - Test RMSE: 0.045407351521714524 - Cross-validated RMSE: 0.07087241651942167

Based on test RMSE and average cross-validated RMSE, my manually tuned ARIMA model is the most successful. The worst performing model is Keras LSTM.

1.4.2 B. Analysis of Results

• Analysis of strengths and weaknesses of each model. 1. ARIMA - Strengths: - Suitable for univariate time series with a clear trend and can smooth out noise and make good short-term forecasts. - High log likelihood. - Low AIC and BIC. - Lowest test and cross-validation RMSE. - Weaknesses: - Requires manual selection/tuning of parameters which is challenging and computationally expensive. - In the context of my data, ARMA assumes a linear relationship in the data, and my dataset appears to have a more logistic growth model. - Coefficients for the AR and MA terms might not all be significantly different from zero which could be a concern for over-parameterization. - Did not capture seasonality that the auto_arima model did. - Complex model with a high order of moving average which could cause overfitting. - Heteroskedastic residuals. - Lower test RMSE than train RMSE.

  1. Auto_arima

    • Strengths:
      • Automatically selects optimal model parameters (not computationally taxing).
      • Captured seasonality that the ARIMA did not.
      • High log likelihood and low AIC & BIC.
      • Significant AR terms (with low p-values).
      • Residuals which hover around 0.
    • Weaknesses:
      • In the context of my data, ARMA assumes a linear relationship in the data, and my dataset appears to have a more logistic growth
      • Struggles with long-term forecasting.
      • Heteroskedasticity.
      • Slight skew and high kurtosis.
      • Higher RMSE than manual ARIMA.
      • Lower test RMSE than train RMSE
  2. Univariate Prophet

    • Strengths:
      • Ability to account for seasonality and holidays effectively, and relatively easy to use.
      • Robust to overfitting for my model.
      • Returned a relatively low average cross-validated RMSE.
      • Stable cross validation performance (robust over time).
      • No systemic bias in residuals.
      • Good model fit indicators (high log likelihood, low AIC & BIC values, and low sigma2)
    • Weaknesses:
      • Good for datasets with strong seasonal effects and several seasons of historical data, which do not apply to my dataset.
      • RMSE was higher than in other models
      • Evidence of overfitting in train and test RMSE discrepancy
      • High coverage in cross-validation suggest that the prediction intervals are too wide
      • Evidence of heteroskedasticity.
      • Presence of outliers and slight skewness
      • Close alignment of cross-validated RMSE with train RMSE as opposed to test RMSE indicates that the model’s performance may vary depending on test set characteristics.
  3. Multivariate Prophet

    • Strengths:
      • Can incorporate additional regressors in my dataset.
      • Ability to account for seasonality and holidays effectively, and relatively easy to use.
      • Flexible trend modeling (better adaptation to complex data patterns)
      • Effective handling of seasonality (multiplicative seasonality)
      • Low cross-validated RMSE reinforces its robustness and reliability.
      • Increased regularization for holiday effects may have helped to manage overfitting.
    • Weaknesses:
      • Potential overfitting/complexity from additional regressors.
      • Feature selection of additional regressors is difficult and could introduce noise
      • Evidence of overfitting in significant discrepancy between train and test RMSE
      • Possibility of complex interactions due to multiple regressors.
      • Risk of misinterpretation of multiple variables especially with the presence of multicollinearity.
  4. XGBoost

    • Strengths:
      • Can capture complex, non-linear relationships in data.
      • Robust to outliers.
      • Can handle NaN values and does not need data to be grouped by Date.
      • Provides insight into feature importance.
      • Flexibility allows it to adapt well to various data types and distributions.
      • Good performance on training data.
    • Weaknesses:
      • Not inherently a time series model.
      • Tuning is computationally expensive (I was unable to perform a GridSearchCV).
      • Evidence of overfitting.
      • Relatively high test RMSE
  5. Keras LSTM

    • Strengths:
      • Can capture complex, non-linear relationships, and long-term dependencies in data.
      • Highly flexible.
      • Improved performance with preprocessing.
      • Effective capture of time-dependent patterns
      • Model can explain a significant proportion of variance in the training set (high training R-squared indicates good fit).
      • Adaptability to non-linear patterns.
    • Weaknesses:
      • Requires large amounts of data to train effectively, and my dataset was quite small.
      • Computationally intensive and requires a lot of manual effort to tune.
      • Overfitting indicated by RMSE discrepancy.
      • High cross-validated RMSE indicates low generalizability.
      • High sensitivity to hyperparameter settings.

• Discussion of factors contributing to the best-performing model.

I believe that there are many factors that contributed to my manually tuned ARIMA model being the best-performing one. In terms of the parameters, the p,d,q selection (2,2,6) reflects a well-tuned balance between both the AR and MA components of the model so that it could capture both short- and long-term trends. As for the d term, I believe that the use of second-order differencing likely aided in stabilizing the mean of the time series allowing it a suitable amount of stationarity for ARIMA models. Next, the sixth-order MA parameter suggests that the ARIMA model can capture complex error structures and longer lagged dependencies (6.2 Moving Averages | Forecasting: Principles and Practice (2nd Ed), n.d.). Furthermore, the lack of seasonal components compared to auto_arima indicates that success may be due to the time series data not having strong seasonal patterns.

Next, I believe that the simplicity of ARIMA as a model generally speaking may have leant to its success. This may have been bolstered by the lack of additional regressors. As I have mentioned, the test dataset is quite simple due to the cumulative nature of the response variable asymptotically reaching 100% vaccine completion. Furthermore, the high log likelihood and low AIC & BIC indicate that the ARIMA model is able to balance good fit and low complexity. There has been evidence of other academics using ARIMA models for cumulative COVID-19 data (ArunKumar et al., 2021). This structure might be well-suited to any autocorrelation issues in the data.

1.5 V. Discussion

I believe the lack of success of these models is purely due to the nature of the dataset at hand. Although it was initially approved, many issues with it affected its quality for time-series modeling. The actual train and test sets that I used ended up being extremely small due to the elimination of observations that occurred before the booster vaccines were created, grouping by Date for those models that needed it, and switching the data to weekly frequency to match the observation cadence from the later parts of the dataset. Additionally, the cumulative nature of the dataset made it inept for time series-modeling.

As for the actual models themselves, overfitting was one of the biggest issues I faced. I think that this may have been because of the severe change in data trends from the train to the test sets as the vaccination rate asymptotically approached 100%. Some of the models that included many parameters such as XGBoost, multivariate Prophet, and Keras LSTM could have fit too closely to the training data and therefore had trouble generalizing to unseen test data. Specifically, the LSTM model relies on large datasets and is powerful in capturing long-term dependencies as opposed to data that accumulates over time (Guide & Saxena, 2023). Another issue is that I did not have the time nor computational resources to perform extensive tuning for all six models. XGBoost, for example, relies on extensive grid search to ensure the best parameters are selected, and I did not have the time to run these. For LSTM, it is also difficult to determine the optimal number of layers and it can take a lot of trial and error to do so. Finally, based on the results of many of the models, heteroskedasticity, residual issues, and inability to capture complex interactions for many of the multivariate models may have led to poor performance.

I feel that this experience was valuable and that I gained knowledge on time-series modeling. I did not have any exposure to time-series modeling aside from the brief unit in Stat 303-2 before this class, and I now feel like I have a solid understanding of the modeling process. Furthermore, I had only used XGBoost and Keras LSTM before this class, so it was a great experience to bolster my skills on those and gain exposure to the other four models. Finally, I now feel more comfortable using GitHub and working on other branches as I had never done that in my previous data science projects.

I enjoyed the group aspect of the project as I felt it was easy to troubleshoot issues, divide duties based on our skills, and efficiently collaborate to produce our best work. I felt like my group worked well with one another and we did not have issues with leadership or responsibility splits. Regarding aspects of the project I was less keen about, I wish that the group element of the project continued until the project report. I feel like I would have still gained exposure to the other models in addition to having time to ensure I achieved the best models for my allocated two. Furthermore, I understand that much of this project was meant for us to research these new models; however, it would have been helpful to have received instruction on how to develop and tune some of the new ones aside from the notebook that Professor Shi published.

1.6 VI. Conclusion

Ultimately, although I achieved some models with relatively low RMSEs, I would say that this project was marked by issues due to the nature of the data. The cumulative nature of the response variable presented unique challenges which affected the performance and suitability of many of the models. As a result, many of the models exhibited signs of overfitting and models that were more complex did not yield results that were better than simpler models. Feature engineering clearly had a significant impact on model performance, and models such as XGBoost revealed that age-specific vaccination rates and manufacturer-specific data proved crucial in some models. Finally, models that could incorporate seasonality such as ARIMA and Prophet tended to demonstrate more accurate forecasting capabilities.

As for specific model findings, the manually tuned ARIMA model emerged as the best performing in capturing the COVID dataframe’s time series dynamics. Auto ARIMA was unable to outperform the manually tuned ARIMA, and both of the ARIMA models had the unusual result of the test RMSE being lower than the train RMSE most likely due to the simplicity of the test set. Both of the Prophet models showed reasonable performance aside from overfitting issues with the univariate model performing better by effectively handling seasonality and trend changes. Despite its powerful and efficient algorithm, the XGBoost model suffered from overfitting, but revealed important insights on feature importances. Finally, the Keras LSTM model struggled with the cumulative and small nature of the dataset resulting in underperformance.

Overall, the cross-validated RMSEs provided a realistic insight on each model’s performance compared to test and train RMSEs and helped to reveal overfitting issues. This project emphasized the importance of model selection for data science issues, and that exploratory data analysis and data preprocessing are imperative to success. Finally, a combination of manual tuning and automatic modeling processes led to modeling success.

Our team worked very effectively together during this project. In our collaborative activities, such as creating presentations and reports, we equally contributed and managed to divide the work efficiently. We recognized and utilized each other’s strengths, which was instrumental in our success. Meeting both in person and over Zoom was crucial, as it allowed us to work together on challenging aspects of the project, like debugging or understanding complex concepts.

From this experience, I’ve learned the importance of acknowledging and leveraging the unique strengths of team members. I now understand that a significant aspect of group work is strategically dividing responsibilities. It’s impossible for one person to cover every aspect of a project efficiently. Having a clear plan and set deadlines is also essential for successful collaboration. In future projects, I plan to focus on identifying where I and my teammates excel to develop an effective strategy for collaborative work.

1.7 VII. References

References

Abulkhair, A. (2023, June 13). Data Imputation Demystified | Time Series Data | by Ahmed Abulkhair. Medium. Retrieved October 25, 2023, from https://medium.com/@aaabulkhair/data-imputation-demystified-time-series-data-69bc9c798cb7

Aggarwal, S. (2023, November 16). The Ultimate Guide to Building Your Own LSTM Models. ProjectPro. Retrieved November 21, 2023, from https://www.projectpro.io/article/lstm-model/832

ArunKumar, K.E., Kalaga, D. V., Kumar, C. M. S., Chilkoor, G., Kawaji, M., & Brenza, T. M. (2021, February 8). Forecasting the dynamics of cumulative COVID-19 cases (confirmed, recovered and deaths) for top-16 countries using statistical machine learning models: Auto-Regressive Integrated Moving Average (ARIMA) and Seasonal Auto-Regressive Integrated Moving Average. National Library of Medicine, 103(107161).

Brownlee, J. (2021, March 19). How to Use XGBoost for Time Series Forecasting - MachineLearningMastery.com. Machine Learning Mastery. Retrieved November 20, 2023, from https://machinelearningmastery.com/xgboost-for-time-series-forecasting/

Brownlee, J. (2023, November 18). How to Create an ARIMA Model for Time Series Forecasting in Python - MachineLearningMastery.com. Machine Learning Mastery. Retrieved November 22, 2023, from https://machinelearningmastery.com/arima-for-time-series-forecasting-with-python/

Chollet, F. (n.d.). LSTM layer. Keras. https://keras.io/api/layers/recurrent_layers/lstm/

Chowdhury, K. (2021, May 24). 10 Hyperparameters to keep an eye on for your LSTM model — and other tips. Medium. Retrieved November 21, 2023, from https://medium.com/geekculture/10-hyperparameters-to-keep-an-eye-on-for-your-lstm-model-and-other-tips-f0ff5b63fcd4

Dancho, M. (2017, July 23). Tidy Time Series Analysis, Part 2: Rolling Functions. Business Science. Retrieved November 20, 2023, from https://www.business-science.io/timeseries-analysis/2017/07/23/tidy-timeseries-analysis-pt-2.html 4.1 Seasonal ARIMA models | STAT 510. (n.d.). STAT ONLINE. Retrieved November 22, 2023, from https://online.stat.psu.edu/stat510/lesson/4/4.1

Guide, S., & Saxena, S. (2023, October 25). What is LSTM? Introduction to Long Short-Term Memory. Analytics Vidhya. Retrieved November 26, 2023, from https://www.analyticsvidhya.com/blog/2021/03/introduction-to-long-short-term-memory-lstm/

Hahn, S. (n.d.). COVID-19 Vaccines. FDA. Retrieved October 25, 2023, from https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/covid-19-vaccines

Hedengren, J. D. (2022). LSTM Networks | Dynamic Optimization. APMonitor. Retrieved November 21, 2023, from https://apmonitor.com/do/index.php/Main/LSTMNetwork

Howson, I. (2023, September 2).* prophet_params: Tuning Parameters for Prophet Models in modeltime: The Tidymodels Extension for Time Series Modeling.* rdrr.io. Retrieved November 24, 2023, from https://rdrr.io/cran/modeltime/man/prophet_params.html Hyndman, R. J., & Athanasopoulos, G. (n.d.). 8.1 Stationarity and differencing | Forecasting: Principles and Practice (2nd ed). OTexts. Retrieved November 23, 2023, from https://otexts.com/fpp2/stationarity.html

Jain, S. (2023, February 6). XGBoost. GeeksforGeeks. Retrieved November 20, 2023, from https://www.geeksforgeeks.org/xgboost/#

Kates, J., Tolbert, J., & Rouw, A. (2021, December 8). An Update on Vaccine Roll-Out for 5-11 Year-olds in the U.S. KFF. Retrieved October 25, 2023, from https://www.kff.org/coronavirus-covid-19/issue-brief/an-update-on-vaccine-roll-out-for-5-11-year-olds-in-the-u-s/

Marks, P. (2022, June 30). Coronavirus (COVID-19) Update: FDA Recommends Inclusion of Omicron BA.4/5 Component for COVID-19 Vaccine Booster Doses. FDA. Retrieved November 19, 2023, from https://www.fda.gov/news-events/press-announcements/coronavirus-covid-19-update-fda-recommends-inclusion-omicron-ba45-component-covid-19-vaccine-booster

Montel, M. (2017). holidays · PyPI. PyPI. Retrieved October 25, 2023, from https://pypi.org/project/holidays/

Munichiello, K. Á. (2023, September 29). Autoregressive Integrated Moving Average (ARIMA) Prediction Model. Investopedia. Retrieved November 22, 2023, from https://www.investopedia.com/terms/a/autoregressive-integrated-moving-average-arima.asp

National Institute of Standards and Technology (NIST). (n.d.). 6.4.4.2. Stationarity. Information Technology Laboratory. Retrieved November 23, 2023, from https://www.itl.nist.gov/div898/handbook/pmc/section4/pmc442.htm

Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V.,

Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, E. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12, 2825–2830. https://scikit-learn.org/stable/about.html#citing-scikit-learn Pramoditha, R. (2022, July 30). One-hot Encode Scalar-value Labels for Deep Learning Models. Medium. Retrieved November 21, 2023, from https://medium.com/data-science-365/one-hot-encode-scalar-value-labels-for-deep-learning-models-4d4053f185c5

Prophet | Forecasting at scale. (n.d.). Meta Open Source. Retrieved November 24, 2023, from https://facebook.github.io/prophet/

Saturating Forecasts | Prophet. (n.d.). Meta Open Source. Retrieved November 25, 2023, from https://facebook.github.io/prophet/docs/saturating_forecasts.html#saturating-minimum

Schmudde, D. (2019, July 26).* Facebook Prophet: Diagnostics.* Nextjournal. Retrieved November 25, 2023, from https://nextjournal.com/fb-prophet/facebook-prophet-diagnostics

6.2 Moving averages | Forecasting: Principles and Practice (2nd ed). (n.d.). OTexts. Retrieved November 26, 2023, from https://otexts.com/fpp2/moving-averages.html

Smith, T. (2017). pmdarima.arima.auto_arima — pmdarima 2.0.4 documentation. alkaline-ml. Retrieved November 23, 2023, from https://alkaline-ml.com/pmdarima/modules/generated/pmdarima.arima.auto_arima.html

xgboost developers. (2022). Python API Reference — xgboost 2.0.2 documentation. XGBoost Documentation. Retrieved November 21, 2023, from https://xgboost.readthedocs.io/en/stable/python/python_api.html

1.8 VIII. Appendices

1.8.1 ARIMA

#### Initial Benchmarking Models

Code
# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(1, 0, 0))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
print(fitted_model_ar1.summary())
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(1, 0, 0)   Log Likelihood                 -90.299
Date:                      Wed, 22 Nov 2023   AIC                            186.599
Time:                              14:46:24   BIC                            192.675
Sample:                          11-03-2021   HQIC                           188.954
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const         30.5404     21.354      1.430      0.153     -11.313      72.394
ar.L1          0.9982      0.023     42.879      0.000       0.953       1.044
sigma2         1.3317      0.317      4.204      0.000       0.711       1.953
===================================================================================
Ljung-Box (L1) (Q):                  32.46   Jarque-Bera (JB):                16.23
Prob(Q):                              0.00   Prob(JB):                         0.00
Heteroskedasticity (H):               0.01   Skew:                             1.27
Prob(H) (two-sided):                  0.00   Kurtosis:                         3.72
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Code
# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(0, 0, 1))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
print(fitted_model_ar1.summary())
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(0, 0, 1)   Log Likelihood                -173.916
Date:                      Wed, 22 Nov 2023   AIC                            353.832
Time:                              14:46:59   BIC                            359.908
Sample:                          11-03-2021   HQIC                           356.187
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const         40.9088      2.749     14.882      0.000      35.521      46.297
ma.L1          0.9998     54.903      0.018      0.985    -106.609     108.608
sigma2        27.1491   1492.012      0.018      0.985   -2897.141    2951.440
===================================================================================
Ljung-Box (L1) (Q):                  32.46   Jarque-Bera (JB):                95.52
Prob(Q):                              0.00   Prob(JB):                         0.00
Heteroskedasticity (H):               0.24   Skew:                            -2.14
Prob(H) (two-sided):                  0.00   Kurtosis:                         7.76
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Code
# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(2, 0, 2))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
print(fitted_model_ar1.summary())
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(2, 0, 2)   Log Likelihood                 -13.802
Date:                      Wed, 22 Nov 2023   AIC                             39.605
Time:                              14:48:15   BIC                             51.757
Sample:                          11-03-2021   HQIC                            44.316
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const         36.7622     36.867      0.997      0.319     -35.496     109.020
ar.L1          1.9873      0.011    186.067      0.000       1.966       2.008
ar.L2         -0.9883      0.010   -103.048      0.000      -1.007      -0.969
ma.L1         -0.2816      0.106     -2.658      0.008      -0.489      -0.074
ma.L2          0.0464      0.165      0.281      0.779      -0.277       0.370
sigma2         0.0747      0.011      6.880      0.000       0.053       0.096
===================================================================================
Ljung-Box (L1) (Q):                   0.25   Jarque-Bera (JB):                13.78
Prob(Q):                              0.62   Prob(JB):                         0.00
Heteroskedasticity (H):               0.01   Skew:                             0.03
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.43
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

#### Tuning procedure with rolling forecast

Code
# Rolling forecast origin evaluation function
def rolling_forecast_origin(train_data, test_data, arima_order):
    history = [x for x in train_data]
    predictions = []
    for t in range(len(test_data)):
        model = ARIMA(history, order=arima_order)
        model_fit = model.fit()
        yhat = model_fit.forecast()[0]
        predictions.append(yhat)
        history.append(test_data[t])
    error = mean_squared_error(test_data, predictions)
    return np.sqrt(error)

# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ar, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Use the rolling forecast origin approach for RMSE calculation
        test_rmse = rolling_forecast_origin(train_ar.values, test_ar.values, param)
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ar.index[0], end=train_ar.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ar, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")
ARIMA(0, 0, 0) - AIC:419.46525268733046
ARIMA(0, 0, 0) - Test RMSE: 8.022117134591838
ARIMA(0, 0, 1) - AIC:353.831709854623
ARIMA(0, 0, 1) - Test RMSE: 4.152413464286231
ARIMA(0, 0, 2) - AIC:294.1296958613109
ARIMA(0, 0, 2) - Test RMSE: 2.2602412466732607
ARIMA(0, 0, 3) - AIC:247.44146407646394
ARIMA(0, 0, 3) - Test RMSE: 1.322336263333452
ARIMA(0, 0, 4) - AIC:206.2336270886833
ARIMA(0, 0, 4) - Test RMSE: 1.0098897418377786
ARIMA(0, 0, 5) - AIC:183.94105170142893
ARIMA(0, 0, 5) - Test RMSE: 0.6520957637436898
ARIMA(0, 0, 6) - AIC:154.29217689751454
ARIMA(0, 0, 6) - Test RMSE: 0.5451991979998692
ARIMA(0, 1, 0) - AIC:173.86903995243946
ARIMA(0, 1, 0) - Test RMSE: 0.06674545718389761
ARIMA(0, 1, 1) - AIC:125.92771001397827
ARIMA(0, 1, 1) - Test RMSE: 0.04321933090740018
ARIMA(0, 1, 2) - AIC:90.75809325607227
ARIMA(0, 1, 2) - Test RMSE: 0.0370450473992982
ARIMA(0, 1, 3) - AIC:73.17886397966525
ARIMA(0, 1, 3) - Test RMSE: 0.059159011341255036
ARIMA(0, 1, 4) - AIC:66.54620036078825
ARIMA(0, 1, 4) - Test RMSE: 0.044707401291116895
ARIMA(0, 1, 5) - AIC:63.52552228981508
ARIMA(0, 1, 5) - Test RMSE: 0.040230722471551864
ARIMA(0, 1, 6) - AIC:52.28160779894589
ARIMA(0, 1, 6) - Test RMSE: 0.05659964869818374
ARIMA(0, 2, 0) - AIC:18.945205028049074
ARIMA(0, 2, 0) - Test RMSE: 0.032102626243352306
ARIMA(0, 2, 1) - AIC:17.55570666378513
ARIMA(0, 2, 1) - Test RMSE: 0.029882246775542198
ARIMA(0, 2, 2) - AIC:19.488807636523262
ARIMA(0, 2, 2) - Test RMSE: 0.029877352389141423
ARIMA(0, 2, 3) - AIC:21.467929030707925
ARIMA(0, 2, 3) - Test RMSE: 0.029667367686781895
ARIMA(0, 2, 4) - AIC:12.756070942948996
ARIMA(0, 2, 4) - Test RMSE: 0.07066450635652603
ARIMA(0, 2, 5) - AIC:11.196081100996398
ARIMA(0, 2, 5) - Test RMSE: 0.06729951185434326
ARIMA(0, 2, 6) - AIC:12.941066346308736
ARIMA(0, 2, 6) - Test RMSE: 0.06821360634192916
ARIMA(1, 0, 0) - AIC:186.5987048733037
ARIMA(1, 0, 0) - Test RMSE: 0.09262371517227826
ARIMA(1, 0, 1) - AIC:138.7357690516774
ARIMA(1, 0, 1) - Test RMSE: 0.05843794773073389
ARIMA(1, 0, 2) - AIC:103.55143002920812
ARIMA(1, 0, 2) - Test RMSE: 0.046568983319965965
ARIMA(1, 0, 3) - AIC:86.04316612968867
ARIMA(1, 0, 3) - Test RMSE: 0.06323244539976906
ARIMA(1, 0, 4) - AIC:79.34553841656023
ARIMA(1, 0, 4) - Test RMSE: 0.0493264500669055
ARIMA(1, 0, 5) - AIC:76.47500446920873
ARIMA(1, 0, 5) - Test RMSE: 0.0438544215159796
ARIMA(1, 0, 6) - AIC:65.71005409862798
ARIMA(1, 0, 6) - Test RMSE: 0.07234379874699833
ARIMA(1, 1, 0) - AIC:24.67237461386862
ARIMA(1, 1, 0) - Test RMSE: 0.03162345886635887
ARIMA(1, 1, 1) - AIC:23.503965156386798
ARIMA(1, 1, 1) - Test RMSE: 0.029592585962986567
ARIMA(1, 1, 2) - AIC:25.429265860310142
ARIMA(1, 1, 2) - Test RMSE: 0.029587492415847388
ARIMA(1, 1, 3) - AIC:27.41317894560359
ARIMA(1, 1, 3) - Test RMSE: 0.02939716228577491
ARIMA(1, 1, 4) - AIC:18.30659024942468
ARIMA(1, 1, 4) - Test RMSE: 0.0702902672897647
ARIMA(1, 1, 5) - AIC:16.557041982200484
ARIMA(1, 1, 5) - Test RMSE: 0.06591090928377968
ARIMA(1, 1, 6) - AIC:18.40240318823562
ARIMA(1, 1, 6) - Test RMSE: 0.06713369600968706
ARIMA(1, 2, 0) - AIC:17.51048444770704
ARIMA(1, 2, 0) - Test RMSE: 0.030087803504630754
ARIMA(1, 2, 1) - AIC:19.482422955533455
ARIMA(1, 2, 1) - Test RMSE: 0.029919701707232384
ARIMA(1, 2, 2) - AIC:17.928499245082044
ARIMA(1, 2, 2) - Test RMSE: 0.02981188711863024
ARIMA(1, 2, 3) - AIC:15.912186889571078
ARIMA(1, 2, 3) - Test RMSE: 0.06661410319359173
ARIMA(1, 2, 4) - AIC:12.705131362000337
ARIMA(1, 2, 4) - Test RMSE: 0.06888143833917935
ARIMA(1, 2, 5) - AIC:13.072471448315795
ARIMA(1, 2, 5) - Test RMSE: 0.06741666583344622
ARIMA(1, 2, 6) - AIC:14.399759217012091
ARIMA(1, 2, 6) - Test RMSE: 0.06691914053459588
ARIMA(2, 0, 0) - AIC:37.43144336155592
ARIMA(2, 0, 0) - Test RMSE: 244.4019036037755
ARIMA(2, 0, 1) - AIC:35.52308445718711
ARIMA(2, 0, 1) - Test RMSE: 0.054291629641910144
ARIMA(2, 0, 2) - AIC:39.60461083018658
Error fitting ARIMA(2, 0, 2): LU decomposition error.
ARIMA(2, 0, 3) - AIC:101.6793844040397
ARIMA(2, 0, 3) - Test RMSE: 0.10499941015062737
ARIMA(2, 0, 4) - AIC:80.17804446122233
ARIMA(2, 0, 4) - Test RMSE: 0.08277471904891026
ARIMA(2, 0, 5) - AIC:83.40028685963307
ARIMA(2, 0, 5) - Test RMSE: 0.048958127408855065
ARIMA(2, 0, 6) - AIC:68.76198629399929
ARIMA(2, 0, 6) - Test RMSE: 0.12544526236246453
ARIMA(2, 1, 0) - AIC:23.431229764079703
ARIMA(2, 1, 0) - Test RMSE: 0.029772013012128246
ARIMA(2, 1, 1) - AIC:25.41874970878186
ARIMA(2, 1, 1) - Test RMSE: 0.0296443724843803
ARIMA(2, 1, 2) - AIC:26.758846769087114
ARIMA(2, 1, 2) - Test RMSE: 0.03051065472101219
ARIMA(2, 1, 3) - AIC:28.645510987648304
ARIMA(2, 1, 3) - Test RMSE: 0.03078178353850982
ARIMA(2, 1, 4) - AIC:18.750860314248634
ARIMA(2, 1, 4) - Test RMSE: 0.05320435734484378
ARIMA(2, 1, 5) - AIC:22.121501045834442
ARIMA(2, 1, 5) - Test RMSE: 0.07669656116938695
ARIMA(2, 1, 6) - AIC:19.677571378194383
ARIMA(2, 1, 6) - Test RMSE: 0.0639527877358055
ARIMA(2, 2, 0) - AIC:19.49840984843423
ARIMA(2, 2, 0) - Test RMSE: 0.029993156585230045
ARIMA(2, 2, 1) - AIC:21.475049304946474
ARIMA(2, 2, 1) - Test RMSE: 0.029943043634026723
ARIMA(2, 2, 2) - AIC:22.804330361766553
ARIMA(2, 2, 2) - Test RMSE: 0.03087450439042665
ARIMA(2, 2, 3) - AIC:14.296926770232261
ARIMA(2, 2, 3) - Test RMSE: 0.06091939933716111
ARIMA(2, 2, 4) - AIC:17.251063825560358
ARIMA(2, 2, 4) - Test RMSE: 0.061387219943471634
ARIMA(2, 2, 5) - AIC:14.157453672559733
ARIMA(2, 2, 5) - Test RMSE: 0.06939662427839606
ARIMA(2, 2, 6) - AIC:15.68366739962045
ARIMA(2, 2, 6) - Test RMSE: 0.06895040064283946
ARIMA(0, 2, 5) with lowest AIC of 11.196081100996398
ARIMA(1, 1, 3) with lowest test RMSE of 0.02939716228577491
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(0, 2, 5)   Log Likelihood                   0.402
Date:                      Wed, 22 Nov 2023   AIC                             11.196
Time:                              16:56:31   BIC                             23.130
Sample:                          11-03-2021   HQIC                            15.799
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ma.L1         -0.4726      3.605     -0.131      0.896      -7.538       6.593
ma.L2          0.1347      0.576      0.234      0.815      -0.994       1.263
ma.L3          0.0187      1.769      0.011      0.992      -3.449       3.486
ma.L4          0.3616      2.930      0.123      0.902      -5.381       6.104
ma.L5          0.3375      1.590      0.212      0.832      -2.780       3.455
sigma2         0.0524      0.242      0.217      0.829      -0.422       0.527
===================================================================================
Ljung-Box (L1) (Q):                   0.13   Jarque-Bera (JB):                12.12
Prob(Q):                              0.72   Prob(JB):                         0.00
Heteroskedasticity (H):               0.06   Skew:                             0.20
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.29
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(1, 1, 3) - Train RMSE: 1.4567745532352823
Best ARIMA(1, 1, 3) - Test RMSE: 0.02939716228577491
Code
# Define the ARIMA order
arima_order113 = (1, 1, 3)

# Fit the ARIMA model
model113 = ARIMA(train_ar, order=arima_order113)
fitted_model113 = model113.fit()

# Predict on the training set
train_pred_ar113 = fitted_model113.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar113 = fitted_model113.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar113 = np.sqrt(mean_squared_error(train_ar, train_pred_ar113))
test_rmse_ar113 = np.sqrt(mean_squared_error(test_ar, test_pred_ar113))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar113}")
print(f"Test RMSE: {test_rmse_ar113}")

# Model summary
fitted_model113.summary()
Train RMSE: 1.4567745532352823
Test RMSE: 1.3596185591349186
SARIMAX Results
Dep. Variable: Additional_Doses_Vax_Pct No. Observations: 56
Model: ARIMA(1, 1, 3) Log Likelihood -8.707
Date: Wed, 22 Nov 2023 AIC 27.413
Time: 18:12:20 BIC 37.450
Sample: 11-03-2021 HQIC 31.294
- 11-23-2022
Covariance Type: opg
coef std err z P>|z| [0.025 0.975]
ar.L1 0.9929 0.009 115.544 0.000 0.976 1.010
ma.L1 -0.2621 0.087 -3.010 0.003 -0.433 -0.091
ma.L2 0.0207 0.191 0.108 0.914 -0.354 0.395
ma.L3 0.0226 0.113 0.200 0.841 -0.198 0.243
sigma2 0.0749 0.011 7.058 0.000 0.054 0.096
Ljung-Box (L1) (Q): 0.31 Jarque-Bera (JB): 16.39
Prob(Q): 0.57 Prob(JB): 0.00
Heteroskedasticity (H): 0.01 Skew: 0.03
Prob(H) (two-sided): 0.00 Kurtosis: 5.67


Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

My results here are still worse compared to the other model types I have looked at. I wanted to experiment with scaled data too as it had helped in my model development in other models. So, I underwent the same process with scaled data.

Code
# Import data with specific columns
df_ars = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime
df_ars['Date'] = pd.to_datetime(df_ars['Date'])

# Group by 'Date' to ensure there is one unique value per date
df_ars = df_ars.groupby('Date').mean()

# Sorting the DataFrame by the index
df_ars.sort_index(inplace=True)

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Scale the predictive variable column
df_ars[pred_var] = scaler.fit_transform(df_ars[[pred_var]])

# Calculate the index for the 70-30 split
split_index = int(len(df_ars) * 0.7)

# Split into train and test
train_ars = df_ars.iloc[:split_index][pred_var]
test_ars = df_ars.iloc[split_index:][pred_var]

# Rolling forecast origin evaluation function
def rolling_forecast_origin(train_data, test_data, arima_order, scaler):
    history = [x for x in train_data]
    predictions = []
    for t in range(len(test_data)):
        model = ARIMA(history, order=arima_order)
        model_fit = model.fit()
        yhat = model_fit.forecast()[0]
        predictions.append(yhat)
        history.append(test_data[t])
    # Scale predictions back to original scale
    predictions_scaled = scaler.inverse_transform(np.array(predictions).reshape(-1, 1)).flatten()
    test_data_scaled = scaler.inverse_transform(test_data.reshape(-1, 1)).flatten()
    error = mean_squared_error(test_data_scaled, predictions_scaled)
    return np.sqrt(error)

# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ars, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Use the rolling forecast origin approach for RMSE calculation
        test_rmse = rolling_forecast_origin(train_ars.values, test_ars.values, param, scaler)
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ars.index[0], end=train_ars.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ars, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")
ARIMA(0, 0, 0) - AIC:4.247377915841888
ARIMA(0, 0, 0) - Test RMSE: 8.022315054137293
ARIMA(0, 0, 1) - AIC:-61.386166557230766
ARIMA(0, 0, 1) - Test RMSE: 4.152567840445752
ARIMA(0, 0, 2) - AIC:-120.75241682724243
ARIMA(0, 0, 2) - Test RMSE: 2.330481228698602
ARIMA(0, 0, 3) - AIC:-167.77581727403606
ARIMA(0, 0, 3) - Test RMSE: 1.3251121150087455
ARIMA(0, 0, 4) - AIC:-208.98721984355345
ARIMA(0, 0, 4) - Test RMSE: 1.0028492021441597
ARIMA(0, 0, 5) - AIC:-238.79317806887153
ARIMA(0, 0, 5) - Test RMSE: 0.5922639034623632
ARIMA(0, 0, 6) - AIC:-260.72140641203134
ARIMA(0, 0, 6) - Test RMSE: 0.49323065088610085
ARIMA(0, 1, 0) - AIC:-233.93423132271894
ARIMA(0, 1, 0) - Test RMSE: 0.06674545718389763
ARIMA(0, 1, 1) - AIC:-281.8755026362179
ARIMA(0, 1, 1) - Test RMSE: 0.04322511089855245
ARIMA(0, 1, 2) - AIC:-317.04502425321454
ARIMA(0, 1, 2) - Test RMSE: 0.03808573700955253
ARIMA(0, 1, 3) - AIC:-334.6221693724792
ARIMA(0, 1, 3) - Test RMSE: 0.06058814659068853
ARIMA(0, 1, 4) - AIC:-341.17129968294756
ARIMA(0, 1, 4) - Test RMSE: 0.04448231200056827
ARIMA(0, 1, 5) - AIC:-344.26377726332
ARIMA(0, 1, 5) - Test RMSE: 0.03907779712741948
ARIMA(0, 1, 6) - AIC:-354.75089008501647
ARIMA(0, 1, 6) - Test RMSE: 0.05320336352322743
ARIMA(0, 2, 0) - AIC:-381.44345120781577
ARIMA(0, 2, 0) - Test RMSE: 0.03210260091573463
ARIMA(0, 2, 1) - AIC:-382.8312301530113
ARIMA(0, 2, 1) - Test RMSE: 0.029916059216671963
ARIMA(0, 2, 2) - AIC:-380.8791307958302
ARIMA(0, 2, 2) - Test RMSE: 0.029802104745564086
ARIMA(0, 2, 3) - AIC:-378.92034573917493
ARIMA(0, 2, 3) - Test RMSE: 0.02984738244131613
ARIMA(0, 2, 4) - AIC:-385.57523592106753
ARIMA(0, 2, 4) - Test RMSE: 0.047231848937613924
ARIMA(0, 2, 5) - AIC:-382.91815096136696
ARIMA(0, 2, 5) - Test RMSE: 0.043669715402971335
ARIMA(0, 2, 6) - AIC:-383.45095430858504
ARIMA(0, 2, 6) - Test RMSE: 0.04032412254754755
ARIMA(1, 0, 0) - AIC:-228.61918020716223
ARIMA(1, 0, 0) - Test RMSE: 0.09263974243801132
ARIMA(1, 0, 1) - AIC:-269.24796001003426
ARIMA(1, 0, 1) - Test RMSE: 0.22020309804244445
ARIMA(1, 0, 2) - AIC:-307.1027082494086
ARIMA(1, 0, 2) - Test RMSE: 0.17787433533647254
ARIMA(1, 0, 3) - AIC:-329.1694480883456
ARIMA(1, 0, 3) - Test RMSE: 0.08541878161043201
ARIMA(1, 0, 4) - AIC:-335.013299468729
ARIMA(1, 0, 4) - Test RMSE: 0.09502312978268243
ARIMA(1, 0, 5) - AIC:-337.7136153956957
ARIMA(1, 0, 5) - Test RMSE: 0.0834411243029291
ARIMA(1, 0, 6) - AIC:-332.4450350634247
ARIMA(1, 0, 6) - Test RMSE: 0.1393014597252537
ARIMA(1, 1, 0) - AIC:-382.877948427655
ARIMA(1, 1, 0) - Test RMSE: 0.03150351946550972
ARIMA(1, 1, 1) - AIC:-384.23718277178415
ARIMA(1, 1, 1) - Test RMSE: 0.029548993455389843
ARIMA(1, 1, 2) - AIC:-382.3689356103163
ARIMA(1, 1, 2) - Test RMSE: 0.029537356495194723
ARIMA(1, 1, 3) - AIC:-374.2438675173964
ARIMA(1, 1, 3) - Test RMSE: 0.0318947940413857
ARIMA(1, 1, 4) - AIC:-387.97730073335714
ARIMA(1, 1, 4) - Test RMSE: 0.069813639407052
ARIMA(1, 1, 5) - AIC:-388.7020424979628
ARIMA(1, 1, 5) - Test RMSE: 0.04545206078459003
ARIMA(1, 1, 6) - AIC:-388.4099480064063
ARIMA(1, 1, 6) - Test RMSE: 0.05041420526518064
ARIMA(1, 2, 0) - AIC:-382.8776751931645
ARIMA(1, 2, 0) - Test RMSE: 0.030075668563302196
ARIMA(1, 2, 1) - AIC:-380.87007247939215
ARIMA(1, 2, 1) - Test RMSE: 0.030004443383415666
ARIMA(1, 2, 2) - AIC:-375.7907461572404
ARIMA(1, 2, 2) - Test RMSE: 0.04529816518175966
ARIMA(1, 2, 3) - AIC:-377.41886357440137
ARIMA(1, 2, 3) - Test RMSE: 0.029695505958044835
ARIMA(1, 2, 4) - AIC:-383.63415198973996
ARIMA(1, 2, 4) - Test RMSE: 0.04120134831239242
ARIMA(1, 2, 5) - AIC:-385.0860947023966
ARIMA(1, 2, 5) - Test RMSE: 0.04095503469090788
ARIMA(1, 2, 6) - AIC:-382.50216905749863
ARIMA(1, 2, 6) - Test RMSE: 0.04250222107552389
ARIMA(2, 0, 0) - AIC:-373.16946963052357
ARIMA(2, 0, 0) - Test RMSE: 0.08784516737856549
ARIMA(2, 0, 1) - AIC:-376.1986841777029
ARIMA(2, 0, 1) - Test RMSE: 0.09397302419826165
ARIMA(2, 0, 2) - AIC:-282.4086129935133
ARIMA(2, 0, 2) - Test RMSE: 0.11348935993478085
ARIMA(2, 0, 3) - AIC:-311.3186709873355
ARIMA(2, 0, 3) - Test RMSE: 0.07042407499986683
ARIMA(2, 0, 4) - AIC:-328.1302481051966
ARIMA(2, 0, 4) - Test RMSE: 0.07421664358695579
ARIMA(2, 0, 5) - AIC:-331.6524564508811
ARIMA(2, 0, 5) - Test RMSE: 0.06679444250949447
ARIMA(2, 0, 6) - AIC:-292.10284992382935
ARIMA(2, 0, 6) - Test RMSE: 0.34245584847869404
ARIMA(2, 1, 0) - AIC:-384.368303927542
ARIMA(2, 1, 0) - Test RMSE: 0.0300182371214265
ARIMA(2, 1, 1) - AIC:-382.1998843707397
ARIMA(2, 1, 1) - Test RMSE: 0.030878562382686502
ARIMA(2, 1, 2) - AIC:-380.8129483990026
ARIMA(2, 1, 2) - Test RMSE: 0.03028759834008332
ARIMA(2, 1, 3) - AIC:-378.72694645280524
ARIMA(2, 1, 3) - Test RMSE: 0.030888671095635985
ARIMA(2, 1, 4) - AIC:-377.06711037555243
ARIMA(2, 1, 4) - Test RMSE: 0.02931363955366861
ARIMA(2, 1, 5) - AIC:-384.2577072621762
ARIMA(2, 1, 5) - Test RMSE: 0.047553882187501874
ARIMA(2, 1, 6) - AIC:-386.6125135638169
ARIMA(2, 1, 6) - Test RMSE: 0.04723028801801355
ARIMA(2, 2, 0) - AIC:-380.8901883396523
ARIMA(2, 2, 0) - Test RMSE: 0.0299905486947701
ARIMA(2, 2, 1) - AIC:-378.89418192149424
ARIMA(2, 2, 1) - Test RMSE: 0.02995423700309308
ARIMA(2, 2, 2) - AIC:-376.90090791610766
ARIMA(2, 2, 2) - Test RMSE: 0.029802348962896113
ARIMA(2, 2, 3) - AIC:-378.4137824836483
ARIMA(2, 2, 3) - Test RMSE: 0.028870934969235946
ARIMA(2, 2, 4) - AIC:-381.2931815248008
ARIMA(2, 2, 4) - Test RMSE: 0.030979999634604606
ARIMA(2, 2, 5) - AIC:-383.15434495370494
ARIMA(2, 2, 5) - Test RMSE: 0.03702201158236212
ARIMA(2, 2, 6) - AIC:-382.9672222960308
ARIMA(2, 2, 6) - Test RMSE: 0.0462943717318562
ARIMA(1, 1, 5) with lowest AIC of -388.7020424979628
ARIMA(2, 2, 3) with lowest test RMSE of 0.028870934969235946
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(1, 1, 5)   Log Likelihood                 201.351
Date:                      Wed, 22 Nov 2023   AIC                           -388.702
Time:                              16:57:58   BIC                           -374.651
Sample:                          11-03-2021   HQIC                          -383.268
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1          0.9451      0.022     42.845      0.000       0.902       0.988
ma.L1         -0.3162      0.200     -1.584      0.113      -0.707       0.075
ma.L2          0.1448      0.158      0.915      0.360      -0.165       0.455
ma.L3         -0.0399      0.198     -0.201      0.840      -0.428       0.348
ma.L4          0.2786      0.242      1.153      0.249      -0.195       0.752
ma.L5          0.3989      0.215      1.854      0.064      -0.023       0.821
sigma2      3.529e-05   1.27e-05      2.787      0.005    1.05e-05    6.01e-05
===================================================================================
Ljung-Box (L1) (Q):                   1.41   Jarque-Bera (JB):                20.36
Prob(Q):                              0.24   Prob(JB):                         0.00
Heteroskedasticity (H):               0.06   Skew:                             0.79
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.53
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(2, 2, 3) - Train RMSE: 0.011363769653325214
Best ARIMA(2, 2, 3) - Test RMSE: 0.028870934969235946
Code
# Fit the ARIMA model223 with (2, 2, 3) parameters on the training data
model223 = ARIMA(train_ars, order=(2, 2, 3))
fitted_model223 = model223.fit()

# Predict on the train set
train_pred_scaled = fitted_model223.predict(start=train_ars.index[0], end=train_ars.index[-1], dynamic=False)

# Inverse transform the train predictions and actual values
train_pred = scaler.inverse_transform(train_pred_scaled.values.reshape(-1, 1)).flatten()
train_actual = scaler.inverse_transform(train_ars.values.reshape(-1, 1)).flatten()

# Predict on the test set
test_pred_scaled = fitted_model223.predict(start=test_ars.index[0], end=test_ars.index[-1], dynamic=False)

# Inverse transform the test predictions and actual values
test_pred = scaler.inverse_transform(test_pred_scaled.values.reshape(-1, 1)).flatten()
test_actual = scaler.inverse_transform(test_ars.values.reshape(-1, 1)).flatten()

# Calculate the RMSE for both train and test sets
train_rmse = np.sqrt(mean_squared_error(train_actual, train_pred))
test_rmse = np.sqrt(mean_squared_error(test_actual, test_pred))

# Print the RMSE values
print(f'Train RMSE: {train_rmse}')
print(f'Test RMSE: {test_rmse}')
Train RMSE: 0.46300258981266973
Test RMSE: 1.4118959165705978

1.8.2 auto_arima

#### Other models

Code
# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Import data with specific columns
df = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime and group by 'Date'
df['Date'] = pd.to_datetime(df['Date'])
df = df.groupby('Date')[pred_var].mean()

# Sorting the DataFrame by the index
df.sort_index(inplace=True)

# Calculate the index for the 70-30 split
split_index = int(len(df) * 0.7)

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_scaled = pd.DataFrame(scaler.fit_transform(df.values.reshape(-1, 1)), index=df.index, columns=[pred_var])

# Calculate the index for the 70-30 split
split_index = int(len(df_scaled) * 0.7)

# Split into scaled and differenced train and test sets
train_aar = df_scaled_diff.iloc[:split_index]
test_aar = df_scaled_diff.iloc[split_index:]
Code
# Run auto_arima to find optimal SARIMA model parameters
model = auto_arima(train, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=24,
                        start_P=0, seasonal=True,
                        d=1, D=1, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=True)

print(model.summary())
print(f"AIC: {model.aic()}")
Performing stepwise search to minimize aic
 ARIMA(0,1,0)(0,1,1)[24]             : AIC=111.122, Time=0.13 sec
 ARIMA(0,1,0)(0,1,0)[24]             : AIC=109.139, Time=0.01 sec
 ARIMA(1,1,0)(1,1,0)[24]             : AIC=35.530, Time=0.25 sec
 ARIMA(0,1,1)(0,1,1)[24]             : AIC=88.230, Time=0.09 sec
 ARIMA(1,1,0)(0,1,0)[24]             : AIC=33.570, Time=0.04 sec
 ARIMA(1,1,0)(0,1,1)[24]             : AIC=35.528, Time=0.24 sec
 ARIMA(1,1,0)(1,1,1)[24]             : AIC=37.496, Time=0.57 sec
 ARIMA(2,1,0)(0,1,0)[24]             : AIC=33.154, Time=0.07 sec
 ARIMA(2,1,0)(1,1,0)[24]             : AIC=35.092, Time=0.53 sec
 ARIMA(2,1,0)(0,1,1)[24]             : AIC=35.083, Time=0.73 sec
 ARIMA(2,1,0)(1,1,1)[24]             : AIC=inf, Time=1.31 sec
 ARIMA(3,1,0)(0,1,0)[24]             : AIC=34.936, Time=0.10 sec
 ARIMA(2,1,1)(0,1,0)[24]             : AIC=32.316, Time=0.10 sec
 ARIMA(2,1,1)(1,1,0)[24]             : AIC=34.234, Time=0.67 sec
 ARIMA(2,1,1)(0,1,1)[24]             : AIC=34.224, Time=0.81 sec
 ARIMA(2,1,1)(1,1,1)[24]             : AIC=inf, Time=0.93 sec
 ARIMA(1,1,1)(0,1,0)[24]             : AIC=33.529, Time=0.16 sec
 ARIMA(3,1,1)(0,1,0)[24]             : AIC=34.314, Time=0.12 sec
 ARIMA(2,1,2)(0,1,0)[24]             : AIC=34.314, Time=0.13 sec
 ARIMA(1,1,2)(0,1,0)[24]             : AIC=35.339, Time=0.07 sec
 ARIMA(3,1,2)(0,1,0)[24]             : AIC=inf, Time=0.15 sec
 ARIMA(2,1,1)(0,1,0)[24] intercept   : AIC=33.247, Time=0.10 sec

Best model:  ARIMA(2,1,1)(0,1,0)[24]          
Total fit time: 7.333 seconds
                                      SARIMAX Results                                      
===========================================================================================
Dep. Variable:                                   y   No. Observations:                   56
Model:             SARIMAX(2, 1, 1)x(0, 1, [], 24)   Log Likelihood                 -12.158
Date:                             Thu, 23 Nov 2023   AIC                             32.316
Time:                                     20:35:36   BIC                             38.052
Sample:                                 11-03-2021   HQIC                            34.186
                                      - 11-23-2022                                         
Covariance Type:                               opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1          0.0145      0.108      0.134      0.893      -0.198       0.227
ar.L2          0.9478      0.101      9.349      0.000       0.749       1.147
ma.L1          0.8366      0.285      2.937      0.003       0.278       1.395
sigma2         0.1137      0.029      3.885      0.000       0.056       0.171
===================================================================================
Ljung-Box (L1) (Q):                   0.40   Jarque-Bera (JB):                 2.59
Prob(Q):                              0.53   Prob(JB):                         0.27
Heteroskedasticity (H):               0.05   Skew:                            -0.58
Prob(H) (two-sided):                  0.00   Kurtosis:                         3.81
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
AIC: 32.315813157645294
Code
# Train results
train_pred = model.predict_in_sample()
pd.concat([train, pd.Series(train_pred, index=train.index)], axis=1).plot(figsize=(20,8))
plt.legend(['train', 'train_pred'])

# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = model.predict(n_periods=len(test))
pd.concat([test, pd.Series(test_pred)], axis=1).plot(figsize=(20,8))
plt.legend(['test', 'test_pred'])

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test, test_pred))
print(f"Test RMSE: {test_rmse}")
Train RMSE: 1.9511986886411419
Test RMSE: 1.4335598585179004

Code
# Run auto_arima to find optimal SARIMA model parameters
model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=13,
                        start_P=0, seasonal=True,
                        d=1, D=1, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

print(model.summary())
print(f"AIC: {model.aic()}")
 ARIMA(0,1,0)(0,1,0)[13]             : AIC=-261.720, Time=0.04 sec
 ARIMA(0,1,0)(0,1,1)[13]             : AIC=-265.485, Time=0.55 sec
 ARIMA(0,1,0)(0,1,2)[13]             : AIC=-263.409, Time=0.43 sec
 ARIMA(0,1,0)(1,1,0)[13]             : AIC=-264.318, Time=0.18 sec
 ARIMA(0,1,0)(1,1,1)[13]             : AIC=-253.103, Time=0.09 sec
 ARIMA(0,1,0)(1,1,2)[13]             : AIC=-261.569, Time=0.58 sec
 ARIMA(0,1,0)(2,1,0)[13]             : AIC=-257.233, Time=0.83 sec
 ARIMA(0,1,0)(2,1,1)[13]             : AIC=-261.618, Time=0.73 sec
 ARIMA(0,1,0)(2,1,2)[13]             : AIC=-259.473, Time=1.76 sec
 ARIMA(0,1,1)(0,1,0)[13]             : AIC=-266.884, Time=0.03 sec
 ARIMA(0,1,1)(0,1,1)[13]             : AIC=-267.941, Time=0.34 sec
 ARIMA(0,1,1)(0,1,2)[13]             : AIC=-265.803, Time=0.61 sec
 ARIMA(0,1,1)(1,1,0)[13]             : AIC=-267.684, Time=0.21 sec
 ARIMA(0,1,1)(1,1,1)[13]             : AIC=-265.926, Time=0.51 sec
 ARIMA(0,1,1)(1,1,2)[13]             : AIC=-263.923, Time=1.43 sec
 ARIMA(0,1,1)(2,1,0)[13]             : AIC=-265.855, Time=0.67 sec
 ARIMA(0,1,1)(2,1,1)[13]             : AIC=-263.912, Time=0.45 sec
 ARIMA(0,1,1)(2,1,2)[13]             : AIC=-261.862, Time=0.65 sec
 ARIMA(0,1,2)(0,1,0)[13]             : AIC=-264.994, Time=0.06 sec
 ARIMA(0,1,2)(0,1,1)[13]             : AIC=-265.978, Time=0.31 sec
 ARIMA(0,1,2)(0,1,2)[13]             : AIC=-263.662, Time=0.49 sec
 ARIMA(0,1,2)(1,1,0)[13]             : AIC=-265.852, Time=0.27 sec
 ARIMA(0,1,2)(1,1,1)[13]             : AIC=-264.064, Time=0.63 sec
 ARIMA(0,1,2)(1,1,2)[13]             : AIC=-261.972, Time=1.31 sec
 ARIMA(0,1,2)(2,1,0)[13]             : AIC=-255.436, Time=0.55 sec
 ARIMA(0,1,2)(2,1,1)[13]             : AIC=-262.061, Time=1.12 sec
 ARIMA(0,1,3)(0,1,0)[13]             : AIC=-264.188, Time=0.05 sec
 ARIMA(0,1,3)(0,1,1)[13]             : AIC=-264.196, Time=0.86 sec
 ARIMA(0,1,3)(0,1,2)[13]             : AIC=-262.210, Time=1.48 sec
 ARIMA(0,1,3)(1,1,0)[13]             : AIC=-264.063, Time=0.22 sec
 ARIMA(0,1,3)(1,1,1)[13]             : AIC=-262.240, Time=0.66 sec
 ARIMA(0,1,3)(2,1,0)[13]             : AIC=-260.620, Time=1.13 sec
 ARIMA(0,1,4)(0,1,0)[13]             : AIC=-267.232, Time=0.20 sec
 ARIMA(0,1,4)(0,1,1)[13]             : AIC=-269.541, Time=0.49 sec
 ARIMA(0,1,4)(1,1,0)[13]             : AIC=-270.738, Time=0.38 sec
 ARIMA(0,1,5)(0,1,0)[13]             : AIC=-267.481, Time=0.15 sec
 ARIMA(1,1,0)(0,1,0)[13]             : AIC=-266.119, Time=0.02 sec
 ARIMA(1,1,0)(0,1,1)[13]             : AIC=-267.284, Time=0.25 sec
 ARIMA(1,1,0)(0,1,2)[13]             : AIC=-265.367, Time=0.24 sec
 ARIMA(1,1,0)(1,1,0)[13]             : AIC=-267.302, Time=0.26 sec
 ARIMA(1,1,0)(1,1,1)[13]             : AIC=-265.531, Time=0.33 sec
 ARIMA(1,1,0)(1,1,2)[13]             : AIC=-263.429, Time=0.53 sec
 ARIMA(1,1,0)(2,1,0)[13]             : AIC=-262.524, Time=1.28 sec
 ARIMA(1,1,0)(2,1,1)[13]             : AIC=-263.449, Time=0.33 sec
 ARIMA(1,1,0)(2,1,2)[13]             : AIC=-261.298, Time=1.10 sec
 ARIMA(1,1,1)(0,1,0)[13]             : AIC=-264.996, Time=0.03 sec
 ARIMA(1,1,1)(0,1,1)[13]             : AIC=-265.980, Time=0.44 sec
 ARIMA(1,1,1)(0,1,2)[13]             : AIC=-263.969, Time=1.14 sec
 ARIMA(1,1,1)(1,1,0)[13]             : AIC=-265.789, Time=0.25 sec
 ARIMA(1,1,1)(1,1,1)[13]             : AIC=-264.056, Time=0.68 sec
 ARIMA(1,1,1)(1,1,2)[13]             : AIC=-262.013, Time=1.83 sec
 ARIMA(1,1,1)(2,1,0)[13]             : AIC=-260.057, Time=0.76 sec
 ARIMA(1,1,1)(2,1,1)[13]             : AIC=-261.996, Time=1.35 sec
 ARIMA(1,1,2)(0,1,0)[13]             : AIC=-263.662, Time=0.15 sec
 ARIMA(1,1,2)(0,1,1)[13]             : AIC=-263.508, Time=0.53 sec
 ARIMA(1,1,2)(0,1,2)[13]             : AIC=inf, Time=1.25 sec
 ARIMA(1,1,2)(1,1,0)[13]             : AIC=-265.580, Time=0.43 sec
 ARIMA(1,1,2)(1,1,1)[13]             : AIC=-261.364, Time=1.09 sec
 ARIMA(1,1,2)(2,1,0)[13]             : AIC=-261.733, Time=1.52 sec
 ARIMA(1,1,3)(0,1,0)[13]             : AIC=-263.859, Time=0.18 sec
 ARIMA(1,1,3)(0,1,1)[13]             : AIC=-264.011, Time=1.69 sec
 ARIMA(1,1,3)(1,1,0)[13]             : AIC=-263.726, Time=0.61 sec
 ARIMA(1,1,4)(0,1,0)[13]             : AIC=-265.626, Time=0.29 sec
 ARIMA(2,1,0)(0,1,0)[13]             : AIC=-265.035, Time=0.03 sec
 ARIMA(2,1,0)(0,1,1)[13]             : AIC=-265.352, Time=0.70 sec
 ARIMA(2,1,0)(0,1,2)[13]             : AIC=-263.782, Time=0.79 sec
 ARIMA(2,1,0)(1,1,0)[13]             : AIC=-265.307, Time=0.17 sec
 ARIMA(2,1,0)(1,1,1)[13]             : AIC=-263.814, Time=0.64 sec
 ARIMA(2,1,0)(1,1,2)[13]             : AIC=-261.826, Time=1.78 sec
 ARIMA(2,1,0)(2,1,0)[13]             : AIC=-259.586, Time=1.08 sec
 ARIMA(2,1,0)(2,1,1)[13]             : AIC=-261.763, Time=1.32 sec
 ARIMA(2,1,1)(0,1,0)[13]             : AIC=-262.719, Time=0.06 sec
 ARIMA(2,1,1)(0,1,1)[13]             : AIC=-263.609, Time=0.33 sec
 ARIMA(2,1,1)(0,1,2)[13]             : AIC=-261.622, Time=1.85 sec
 ARIMA(2,1,1)(1,1,0)[13]             : AIC=-263.552, Time=0.07 sec
 ARIMA(2,1,1)(1,1,1)[13]             : AIC=-261.955, Time=0.65 sec
 ARIMA(2,1,1)(2,1,0)[13]             : AIC=-258.642, Time=1.16 sec
 ARIMA(2,1,2)(0,1,0)[13]             : AIC=inf, Time=0.20 sec
 ARIMA(2,1,2)(0,1,1)[13]             : AIC=-259.896, Time=0.62 sec
 ARIMA(2,1,2)(1,1,0)[13]             : AIC=inf, Time=0.63 sec
 ARIMA(2,1,3)(0,1,0)[13]             : AIC=-261.229, Time=0.13 sec
 ARIMA(3,1,0)(0,1,0)[13]             : AIC=-263.219, Time=0.04 sec
 ARIMA(3,1,0)(0,1,1)[13]             : AIC=-264.560, Time=0.45 sec
 ARIMA(3,1,0)(0,1,2)[13]             : AIC=-263.517, Time=0.77 sec
 ARIMA(3,1,0)(1,1,0)[13]             : AIC=-264.318, Time=0.18 sec
 ARIMA(3,1,0)(1,1,1)[13]             : AIC=-263.357, Time=0.75 sec
 ARIMA(3,1,0)(2,1,0)[13]             : AIC=-262.874, Time=0.88 sec
 ARIMA(3,1,1)(0,1,0)[13]             : AIC=-261.157, Time=0.11 sec
 ARIMA(3,1,1)(0,1,1)[13]             : AIC=-262.172, Time=0.70 sec
 ARIMA(3,1,1)(1,1,0)[13]             : AIC=-262.079, Time=0.51 sec
 ARIMA(3,1,2)(0,1,0)[13]             : AIC=-259.058, Time=0.07 sec
 ARIMA(4,1,0)(0,1,0)[13]             : AIC=-261.323, Time=0.08 sec
 ARIMA(4,1,0)(0,1,1)[13]             : AIC=-263.240, Time=0.46 sec
 ARIMA(4,1,0)(1,1,0)[13]             : AIC=-265.079, Time=0.54 sec
 ARIMA(4,1,1)(0,1,0)[13]             : AIC=-259.500, Time=0.08 sec
 ARIMA(5,1,0)(0,1,0)[13]             : AIC=-261.304, Time=0.12 sec

Best model:  ARIMA(0,1,4)(1,1,0)[13]          
Total fit time: 57.026 seconds
                                      SARIMAX Results                                      
===========================================================================================
Dep. Variable:                                   y   No. Observations:                   55
Model:             SARIMAX(0, 1, 4)x(1, 1, [], 13)   Log Likelihood                 141.369
Date:                             Thu, 23 Nov 2023   AIC                           -270.738
Time:                                     22:17:13   BIC                           -260.457
Sample:                                 11-10-2021   HQIC                          -266.994
                                      - 11-23-2022                                         
Covariance Type:                               opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ma.L1         -0.4818      0.315     -1.530      0.126      -1.099       0.135
ma.L2         -0.0384      0.180     -0.213      0.831      -0.392       0.315
ma.L3         -0.0837      0.155     -0.541      0.589      -0.387       0.219
ma.L4          0.5427      0.270      2.009      0.045       0.013       1.072
ar.S.L13      -0.5870      0.161     -3.656      0.000      -0.902      -0.272
sigma2      5.044e-05   1.39e-05      3.626      0.000    2.32e-05    7.77e-05
===================================================================================
Ljung-Box (L1) (Q):                   0.28   Jarque-Bera (JB):                 6.13
Prob(Q):                              0.60   Prob(JB):                         0.05
Heteroskedasticity (H):               0.20   Skew:                             0.63
Prob(H) (two-sided):                  0.00   Kurtosis:                         4.42
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
AIC: -270.7383913482854
Code
# Train results
train_pred = model.predict_in_sample()
pd.concat([train_aar, pd.Series(train_pred, index=train.index)], axis=1).plot(figsize=(20,8))
plt.legend(['train', 'train_pred'])

# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = model.predict(n_periods=len(test_aar))
pd.concat([test_aar, pd.Series(test_pred)], axis=1).plot(figsize=(20,8))
plt.legend(['test', 'test_pred'])

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")
Train RMSE: 0.01428498512894508
Test RMSE: 0.003313281635609583

Code
# Run auto_arima to find optimal SARIMA model parameters
model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=24,
                        start_P=0, seasonal=True,
                        d=2, D = 0, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

print(model.summary())
print(f"AIC: {model.aic()}")
 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-332.058, Time=0.03 sec
 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-330.058, Time=0.18 sec
 ARIMA(0,2,0)(0,0,2)[24]             : AIC=-328.058, Time=0.16 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-330.058, Time=0.34 sec
 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-328.058, Time=0.07 sec
 ARIMA(0,2,0)(1,0,2)[24]             : AIC=-326.058, Time=0.46 sec
 ARIMA(0,2,0)(2,0,0)[24]             : AIC=-328.058, Time=0.53 sec
 ARIMA(0,2,0)(2,0,1)[24]             : AIC=-326.058, Time=0.23 sec
 ARIMA(0,2,0)(2,0,2)[24]             : AIC=-324.058, Time=0.45 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=-377.163, Time=0.03 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=-374.746, Time=0.25 sec
 ARIMA(0,2,1)(0,0,2)[24]             : AIC=-368.056, Time=0.82 sec
 ARIMA(0,2,1)(1,0,0)[24]             : AIC=-375.194, Time=0.30 sec
 ARIMA(0,2,1)(1,0,1)[24]             : AIC=-368.056, Time=0.15 sec
 ARIMA(0,2,1)(1,0,2)[24]             : AIC=-371.186, Time=0.88 sec
 ARIMA(0,2,1)(2,0,0)[24]             : AIC=-371.911, Time=0.81 sec
 ARIMA(0,2,1)(2,0,1)[24]             : AIC=-371.169, Time=0.84 sec
 ARIMA(0,2,1)(2,0,2)[24]             : AIC=-364.056, Time=0.36 sec
 ARIMA(0,2,2)(0,0,0)[24]             : AIC=-381.008, Time=0.05 sec
 ARIMA(0,2,2)(0,0,1)[24]             : AIC=-377.905, Time=0.22 sec
 ARIMA(0,2,2)(0,0,2)[24]             : AIC=-374.369, Time=0.93 sec
 ARIMA(0,2,2)(1,0,0)[24]             : AIC=-378.652, Time=0.10 sec
 ARIMA(0,2,2)(1,0,1)[24]             : AIC=-377.857, Time=0.34 sec
 ARIMA(0,2,2)(1,0,2)[24]             : AIC=-374.883, Time=1.03 sec
 ARIMA(0,2,2)(2,0,0)[24]             : AIC=-376.276, Time=0.95 sec
 ARIMA(0,2,2)(2,0,1)[24]             : AIC=-375.658, Time=1.18 sec
 ARIMA(0,2,3)(0,0,0)[24]             : AIC=-378.737, Time=0.03 sec
 ARIMA(0,2,3)(0,0,1)[24]             : AIC=-377.331, Time=0.29 sec
 ARIMA(0,2,3)(0,0,2)[24]             : AIC=-374.742, Time=0.63 sec
 ARIMA(0,2,3)(1,0,0)[24]             : AIC=-377.046, Time=0.32 sec
 ARIMA(0,2,3)(1,0,1)[24]             : AIC=-374.749, Time=0.54 sec
 ARIMA(0,2,3)(2,0,0)[24]             : AIC=-374.741, Time=0.83 sec
 ARIMA(0,2,4)(0,0,0)[24]             : AIC=-375.866, Time=0.08 sec
 ARIMA(0,2,4)(0,0,1)[24]             : AIC=-374.653, Time=0.61 sec
 ARIMA(0,2,4)(1,0,0)[24]             : AIC=-374.239, Time=0.50 sec
 ARIMA(0,2,5)(0,0,0)[24]             : AIC=-381.186, Time=0.10 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-355.610, Time=0.02 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-353.610, Time=0.04 sec
 ARIMA(1,2,0)(0,0,2)[24]             : AIC=-351.610, Time=0.17 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-353.985, Time=0.12 sec
 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-351.992, Time=0.07 sec
 ARIMA(1,2,0)(1,0,2)[24]             : AIC=-350.001, Time=0.70 sec
 ARIMA(1,2,0)(2,0,0)[24]             : AIC=-351.610, Time=0.12 sec
 ARIMA(1,2,0)(2,0,1)[24]             : AIC=-349.610, Time=0.19 sec
 ARIMA(1,2,0)(2,0,2)[24]             : AIC=-347.610, Time=0.23 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-380.097, Time=0.07 sec
 ARIMA(1,2,1)(0,0,1)[24]             : AIC=-377.710, Time=0.55 sec
 ARIMA(1,2,1)(0,0,2)[24]             : AIC=-375.791, Time=0.93 sec
 ARIMA(1,2,1)(1,0,0)[24]             : AIC=-375.439, Time=0.71 sec
 ARIMA(1,2,1)(1,0,1)[24]             : AIC=-371.618, Time=0.12 sec
 ARIMA(1,2,1)(1,0,2)[24]             : AIC=-373.953, Time=0.93 sec
 ARIMA(1,2,1)(2,0,0)[24]             : AIC=-371.520, Time=0.67 sec
 ARIMA(1,2,1)(2,0,1)[24]             : AIC=-374.160, Time=2.12 sec
 ARIMA(1,2,2)(0,0,0)[24]             : AIC=-376.748, Time=0.04 sec
 ARIMA(1,2,2)(0,0,1)[24]             : AIC=-375.037, Time=0.44 sec
 ARIMA(1,2,2)(0,0,2)[24]             : AIC=-373.005, Time=1.27 sec
 ARIMA(1,2,2)(1,0,0)[24]             : AIC=-375.029, Time=0.49 sec
 ARIMA(1,2,2)(1,0,1)[24]             : AIC=-372.982, Time=0.32 sec
 ARIMA(1,2,2)(2,0,0)[24]             : AIC=-372.996, Time=1.00 sec
 ARIMA(1,2,3)(0,0,0)[24]             : AIC=-376.687, Time=0.08 sec
 ARIMA(1,2,3)(0,0,1)[24]             : AIC=-375.353, Time=0.60 sec
 ARIMA(1,2,3)(1,0,0)[24]             : AIC=-375.563, Time=0.59 sec
 ARIMA(1,2,4)(0,0,0)[24]             : AIC=-375.364, Time=0.07 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-360.444, Time=0.03 sec
 ARIMA(2,2,0)(0,0,1)[24]             : AIC=-358.532, Time=0.23 sec
 ARIMA(2,2,0)(0,0,2)[24]             : AIC=-356.444, Time=0.50 sec
 ARIMA(2,2,0)(1,0,0)[24]             : AIC=-358.450, Time=0.10 sec
 ARIMA(2,2,0)(1,0,1)[24]             : AIC=-356.522, Time=0.21 sec
 ARIMA(2,2,0)(1,0,2)[24]             : AIC=-354.532, Time=1.36 sec
 ARIMA(2,2,0)(2,0,0)[24]             : AIC=-356.532, Time=1.09 sec
 ARIMA(2,2,0)(2,0,1)[24]             : AIC=-354.524, Time=1.00 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-378.787, Time=0.08 sec
 ARIMA(2,2,1)(0,0,1)[24]             : AIC=-376.292, Time=0.48 sec
 ARIMA(2,2,1)(0,0,2)[24]             : AIC=-374.523, Time=1.20 sec
 ARIMA(2,2,1)(1,0,0)[24]             : AIC=-376.171, Time=0.51 sec
 ARIMA(2,2,1)(1,0,1)[24]             : AIC=-374.634, Time=0.49 sec
 ARIMA(2,2,1)(2,0,0)[24]             : AIC=-374.431, Time=2.04 sec
 ARIMA(2,2,2)(0,0,0)[24]             : AIC=-377.479, Time=0.14 sec
 ARIMA(2,2,2)(0,0,1)[24]             : AIC=-373.993, Time=0.43 sec
 ARIMA(2,2,2)(1,0,0)[24]             : AIC=-375.130, Time=0.65 sec
 ARIMA(2,2,3)(0,0,0)[24]             : AIC=-372.259, Time=0.05 sec
 ARIMA(3,2,0)(0,0,0)[24]             : AIC=-369.320, Time=0.06 sec
 ARIMA(3,2,0)(0,0,1)[24]             : AIC=-366.576, Time=0.10 sec
 ARIMA(3,2,0)(0,0,2)[24]             : AIC=-365.375, Time=0.85 sec
 ARIMA(3,2,0)(1,0,0)[24]             : AIC=-367.391, Time=0.26 sec
 ARIMA(3,2,0)(1,0,1)[24]             : AIC=-365.400, Time=0.51 sec
 ARIMA(3,2,0)(2,0,0)[24]             : AIC=-365.378, Time=0.93 sec
 ARIMA(3,2,1)(0,0,0)[24]             : AIC=-379.013, Time=0.08 sec
 ARIMA(3,2,1)(0,0,1)[24]             : AIC=-377.751, Time=0.51 sec
 ARIMA(3,2,1)(1,0,0)[24]             : AIC=-377.096, Time=0.45 sec
 ARIMA(3,2,2)(0,0,0)[24]             : AIC=-377.994, Time=0.07 sec
 ARIMA(4,2,0)(0,0,0)[24]             : AIC=-375.995, Time=0.06 sec
 ARIMA(4,2,0)(0,0,1)[24]             : AIC=-375.147, Time=0.38 sec
 ARIMA(4,2,0)(1,0,0)[24]             : AIC=-375.147, Time=0.54 sec
 ARIMA(4,2,1)(0,0,0)[24]             : AIC=-378.757, Time=0.06 sec
 ARIMA(5,2,0)(0,0,0)[24]             : AIC=-379.336, Time=0.10 sec

Best model:  ARIMA(0,2,5)(0,0,0)[24]          
Total fit time: 43.955 seconds
                               SARIMAX Results                                
==============================================================================
Dep. Variable:                      y   No. Observations:                   56
Model:               SARIMAX(0, 2, 5)   Log Likelihood                 196.593
Date:                Fri, 24 Nov 2023   AIC                           -381.186
Time:                        14:48:21   BIC                           -369.252
Sample:                    11-10-2021   HQIC                          -376.584
                         - 11-30-2022                                         
Covariance Type:                  opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ma.L1         -1.4028      0.151     -9.311      0.000      -1.698      -1.108
ma.L2          0.4487      0.265      1.694      0.090      -0.070       0.968
ma.L3          0.0476      0.303      0.157      0.875      -0.545       0.641
ma.L4          0.4185      0.271      1.545      0.122      -0.113       0.949
ma.L5         -0.4217      0.173     -2.441      0.015      -0.760      -0.083
sigma2      3.747e-05   6.93e-06      5.405      0.000    2.39e-05    5.11e-05
===================================================================================
Ljung-Box (L1) (Q):                   0.00   Jarque-Bera (JB):                25.15
Prob(Q):                              0.99   Prob(JB):                         0.00
Heteroskedasticity (H):               0.05   Skew:                             0.07
Prob(H) (two-sided):                  0.00   Kurtosis:                         6.34
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
AIC: -381.18635048096525
Code
# Train results
train_pred = model.predict_in_sample()
pd.concat([train_aar, pd.Series(train_pred, index=train.index)], axis=1).plot(figsize=(20,8))
plt.legend(['train', 'train_pred'])

# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = model.predict(n_periods=len(test_aar))
pd.concat([test_aar, pd.Series(test_pred)], axis=1).plot(figsize=(20,8))
plt.legend(['test', 'test_pred'])

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")
Train RMSE: 0.012749488205266932
Test RMSE: 0.0053765108589252245

1.8.3 LSTM

#### Feature Extraction

Below I attempt to use PCA to reduce dimensionality for my LSTM model. However, the corresponding model has a much higher RMSE compared to models without dimension reduction.

Code
# Apply PCA to the scaled data without specifying n_components
pca = PCA()
pca.fit(df_scaled)

# Calculate the cumulative explained variance
cumulative_variance = np.cumsum(pca.explained_variance_ratio_)

# Plot the cumulative explained variance
plt.figure(figsize=(10, 6))
plt.plot(cumulative_variance)
plt.xlabel('Number of Components')
plt.ylabel('Cumulative Explained Variance')
plt.title('Explained Variance by Components')
plt.grid(True)
plt.show()

Code
# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location'
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Additional time-series columns to account for 3-month pattern
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

# Forward fill missing values
df_encoded.fillna(method='ffill', inplace=True)
df_encoded.fillna(method='bfill', inplace=True)

# Initialize MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Separate target variable
target_series = df_encoded[pred_var]

# Apply MinMaxScaler to df_encoded excluding target variable
df_features_scaled = pd.DataFrame(min_max_scaler.fit_transform(df_encoded.drop(pred_var, axis=1)),
                                  columns=df_encoded.drop(pred_var, axis=1).columns, 
                                  index=df_encoded.index)

# Define the number of components for PCA
n_components = 18

# Apply PCA to the scaled feature data
pca = PCA(n_components=n_components)
df_pca = pca.fit_transform(df_features_scaled)

# Convert the PCA output to a DataFrame
df_pca = pd.DataFrame(df_pca, index=df_features_scaled.index)

# Function to create sequences for LSTM
def make_series(features, target, sequence_length):
    series = []
    for location, group in features.groupby(level='Location'):
        # Retrieve the corresponding target values for each location
        target_group = target.xs(location, level='Location')
        
        group = group.reset_index(level='Location', drop=True)
        for i in range(sequence_length, len(group)):
            sequence = group[i - sequence_length:i].values
            target_val = target_group.iloc[i - sequence_length]
            series.append((sequence, target_val))
    return series


# Set sequence length
sequence_length = 12

# Create sequences from the scaled PCA data
data_series = make_series(df_pca, target_series, sequence_length)

# Split into train and test sequences
test_size = 1080  # Size of test set
train_series = data_series[:-test_size]
test_series = data_series[-test_size:]

# Prepare data for LSTM
X_train = np.array([x[0] for x in train_series])  # Feature sequences
y_train = np.array([x[1] for x in train_series])  # Corresponding target values
X_test = np.array([x[0] for x in test_series])    # Feature sequences
y_test = np.array([x[1] for x in test_series])    # Corresponding target values

# Initialize TimeSeriesSplit
tscv = TimeSeriesSplit(n_splits=5)
Code
# Cross-Validation Loop
for train_index, val_index in tscv.split(X_train):
    X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
    y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

    # Define LSTM model
    inputs = Input(shape=(sequence_length, X_train_fold.shape[2]))
    lstm_out = LSTM(32, return_sequences=False)(inputs)
    lstm_out = Dropout(0.2)(lstm_out)
    outputs = Dense(1)(lstm_out)
    model = Model(inputs=inputs, outputs=outputs)
    model.compile(optimizer='adam', loss='mae')

    # Fit the model on this fold
    model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=32,
              validation_data=(X_val_fold, y_val_fold), shuffle=False)

# Final Model Training on Full Train Data
model_final = Model(inputs=inputs, outputs=outputs)
model_final.compile(optimizer='adam', loss='mae')
model_final.fit(X_train, y_train, epochs=100, batch_size=32, shuffle=False)

# Final Model Evaluation on Test Data
y_pred_test = model_final.predict(X_test)
test_rmse = sqrt(mean_squared_error(y_test, y_pred_test))
print(f"Test RMSE: {test_rmse}")
Epoch 1/100
18/18 [==============================] - 3s 36ms/step - loss: 41.2700 - val_loss: 36.7901
Epoch 2/100
18/18 [==============================] - 0s 12ms/step - loss: 41.0454 - val_loss: 36.5897
Epoch 3/100
18/18 [==============================] - 0s 11ms/step - loss: 40.7073 - val_loss: 36.1942
Epoch 4/100
18/18 [==============================] - 0s 10ms/step - loss: 39.9047 - val_loss: 34.8702
Epoch 5/100
18/18 [==============================] - 0s 11ms/step - loss: 37.4582 - val_loss: 31.9053
Epoch 6/100
18/18 [==============================] - 0s 11ms/step - loss: 34.3959 - val_loss: 29.9369
Epoch 7/100
18/18 [==============================] - 0s 10ms/step - loss: 32.6451 - val_loss: 28.7394
Epoch 8/100
18/18 [==============================] - 0s 11ms/step - loss: 31.4477 - val_loss: 27.7984
Epoch 9/100
18/18 [==============================] - 0s 16ms/step - loss: 30.4212 - val_loss: 27.0170
Epoch 10/100
18/18 [==============================] - 0s 17ms/step - loss: 29.6309 - val_loss: 26.3905
Epoch 11/100
18/18 [==============================] - 0s 13ms/step - loss: 28.9338 - val_loss: 25.8153
Epoch 12/100
18/18 [==============================] - 0s 10ms/step - loss: 28.1941 - val_loss: 25.2292
Epoch 13/100
18/18 [==============================] - 0s 11ms/step - loss: 27.5505 - val_loss: 24.6672
Epoch 14/100
18/18 [==============================] - 0s 15ms/step - loss: 27.0346 - val_loss: 24.1747
Epoch 15/100
18/18 [==============================] - 0s 16ms/step - loss: 26.4999 - val_loss: 23.7137
Epoch 16/100
18/18 [==============================] - 0s 25ms/step - loss: 25.8065 - val_loss: 23.2691
Epoch 17/100
18/18 [==============================] - 1s 32ms/step - loss: 25.4968 - val_loss: 22.8375
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 24.8842 - val_loss: 22.4212
Epoch 19/100
18/18 [==============================] - 0s 24ms/step - loss: 24.3579 - val_loss: 22.0171
Epoch 20/100
18/18 [==============================] - 0s 25ms/step - loss: 23.9558 - val_loss: 21.6289
Epoch 21/100
18/18 [==============================] - 0s 18ms/step - loss: 23.5178 - val_loss: 21.2480
Epoch 22/100
18/18 [==============================] - 0s 19ms/step - loss: 23.0664 - val_loss: 20.8744
Epoch 23/100
18/18 [==============================] - 1s 30ms/step - loss: 22.5515 - val_loss: 20.5075
Epoch 24/100
18/18 [==============================] - 0s 19ms/step - loss: 22.2061 - val_loss: 20.1440
Epoch 25/100
18/18 [==============================] - 0s 26ms/step - loss: 21.6603 - val_loss: 19.7860
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 21.2431 - val_loss: 19.4400
Epoch 27/100
18/18 [==============================] - 0s 18ms/step - loss: 20.7687 - val_loss: 19.1007
Epoch 28/100
18/18 [==============================] - 0s 19ms/step - loss: 20.5516 - val_loss: 18.7686
Epoch 29/100
18/18 [==============================] - 0s 16ms/step - loss: 20.1820 - val_loss: 18.4389
Epoch 30/100
18/18 [==============================] - 0s 16ms/step - loss: 19.6237 - val_loss: 18.1181
Epoch 31/100
18/18 [==============================] - 0s 17ms/step - loss: 19.3594 - val_loss: 17.8046
Epoch 32/100
18/18 [==============================] - 0s 18ms/step - loss: 19.1936 - val_loss: 17.5093
Epoch 33/100
18/18 [==============================] - 0s 15ms/step - loss: 18.6082 - val_loss: 17.2287
Epoch 34/100
18/18 [==============================] - 0s 17ms/step - loss: 18.4252 - val_loss: 16.9564
Epoch 35/100
18/18 [==============================] - 0s 18ms/step - loss: 18.0182 - val_loss: 16.6900
Epoch 36/100
18/18 [==============================] - 0s 16ms/step - loss: 17.5838 - val_loss: 16.4270
Epoch 37/100
18/18 [==============================] - 0s 14ms/step - loss: 17.3630 - val_loss: 16.1701
Epoch 38/100
18/18 [==============================] - 0s 15ms/step - loss: 16.8887 - val_loss: 15.5856
Epoch 39/100
18/18 [==============================] - 0s 13ms/step - loss: 16.3791 - val_loss: 14.7756
Epoch 40/100
18/18 [==============================] - 0s 13ms/step - loss: 15.4836 - val_loss: 13.7406
Epoch 41/100
18/18 [==============================] - 0s 13ms/step - loss: 15.3589 - val_loss: 13.1717
Epoch 42/100
18/18 [==============================] - 0s 13ms/step - loss: 14.5395 - val_loss: 12.8523
Epoch 43/100
18/18 [==============================] - 0s 13ms/step - loss: 14.1168 - val_loss: 11.8265
Epoch 44/100
18/18 [==============================] - 0s 13ms/step - loss: 13.5888 - val_loss: 11.8696
Epoch 45/100
18/18 [==============================] - 0s 13ms/step - loss: 13.1455 - val_loss: 11.5745
Epoch 46/100
18/18 [==============================] - 0s 14ms/step - loss: 12.5063 - val_loss: 11.1987
Epoch 47/100
18/18 [==============================] - 0s 18ms/step - loss: 12.2500 - val_loss: 11.4035
Epoch 48/100
18/18 [==============================] - 0s 14ms/step - loss: 11.7360 - val_loss: 10.0793
Epoch 49/100
18/18 [==============================] - 0s 15ms/step - loss: 11.3647 - val_loss: 10.0503
Epoch 50/100
18/18 [==============================] - 0s 13ms/step - loss: 10.7204 - val_loss: 10.6930
Epoch 51/100
18/18 [==============================] - 0s 14ms/step - loss: 10.6088 - val_loss: 10.1400
Epoch 52/100
18/18 [==============================] - 0s 15ms/step - loss: 10.4439 - val_loss: 9.4562
Epoch 53/100
18/18 [==============================] - 0s 14ms/step - loss: 9.7667 - val_loss: 9.1289
Epoch 54/100
18/18 [==============================] - 0s 14ms/step - loss: 9.5961 - val_loss: 9.2415
Epoch 55/100
18/18 [==============================] - 0s 14ms/step - loss: 9.2877 - val_loss: 9.5871
Epoch 56/100
18/18 [==============================] - 0s 13ms/step - loss: 9.3163 - val_loss: 8.1333
Epoch 57/100
18/18 [==============================] - 0s 14ms/step - loss: 8.8027 - val_loss: 8.3146
Epoch 58/100
18/18 [==============================] - 0s 12ms/step - loss: 8.7184 - val_loss: 8.6173
Epoch 59/100
18/18 [==============================] - 0s 13ms/step - loss: 8.4860 - val_loss: 7.1074
Epoch 60/100
18/18 [==============================] - 0s 13ms/step - loss: 8.2112 - val_loss: 7.7605
Epoch 61/100
18/18 [==============================] - 0s 13ms/step - loss: 8.2892 - val_loss: 8.5289
Epoch 62/100
18/18 [==============================] - 0s 13ms/step - loss: 7.8768 - val_loss: 7.3381
Epoch 63/100
18/18 [==============================] - 0s 14ms/step - loss: 7.4530 - val_loss: 7.0460
Epoch 64/100
18/18 [==============================] - 0s 14ms/step - loss: 7.5197 - val_loss: 6.5442
Epoch 65/100
18/18 [==============================] - 0s 15ms/step - loss: 7.1159 - val_loss: 6.4051
Epoch 66/100
18/18 [==============================] - 0s 13ms/step - loss: 7.2056 - val_loss: 6.7575
Epoch 67/100
18/18 [==============================] - 0s 14ms/step - loss: 7.0257 - val_loss: 5.8745
Epoch 68/100
18/18 [==============================] - 0s 14ms/step - loss: 7.1443 - val_loss: 6.4032
Epoch 69/100
18/18 [==============================] - 0s 16ms/step - loss: 7.1765 - val_loss: 7.9892
Epoch 70/100
18/18 [==============================] - 0s 13ms/step - loss: 6.8701 - val_loss: 5.8439
Epoch 71/100
18/18 [==============================] - 0s 14ms/step - loss: 6.7818 - val_loss: 5.5842
Epoch 72/100
18/18 [==============================] - 0s 13ms/step - loss: 6.5038 - val_loss: 5.8211
Epoch 73/100
18/18 [==============================] - 0s 14ms/step - loss: 6.2908 - val_loss: 5.5140
Epoch 74/100
18/18 [==============================] - 0s 15ms/step - loss: 6.4269 - val_loss: 5.1902
Epoch 75/100
18/18 [==============================] - 0s 15ms/step - loss: 6.3986 - val_loss: 5.3324
Epoch 76/100
18/18 [==============================] - 0s 13ms/step - loss: 6.1972 - val_loss: 5.0190
Epoch 77/100
18/18 [==============================] - 0s 12ms/step - loss: 5.9515 - val_loss: 4.7772
Epoch 78/100
18/18 [==============================] - 0s 13ms/step - loss: 6.0191 - val_loss: 4.9257
Epoch 79/100
18/18 [==============================] - 0s 14ms/step - loss: 6.1933 - val_loss: 6.0620
Epoch 80/100
18/18 [==============================] - 0s 14ms/step - loss: 5.8201 - val_loss: 5.0276
Epoch 81/100
18/18 [==============================] - 0s 12ms/step - loss: 5.6295 - val_loss: 4.4822
Epoch 82/100
18/18 [==============================] - 0s 12ms/step - loss: 5.7347 - val_loss: 4.7112
Epoch 83/100
18/18 [==============================] - 0s 13ms/step - loss: 5.6434 - val_loss: 5.5602
Epoch 84/100
18/18 [==============================] - 0s 16ms/step - loss: 5.5992 - val_loss: 4.0682
Epoch 85/100
18/18 [==============================] - 0s 14ms/step - loss: 5.4496 - val_loss: 4.6046
Epoch 86/100
18/18 [==============================] - 0s 13ms/step - loss: 5.3008 - val_loss: 4.9197
Epoch 87/100
18/18 [==============================] - 0s 13ms/step - loss: 5.1234 - val_loss: 5.1979
Epoch 88/100
18/18 [==============================] - 0s 14ms/step - loss: 4.9743 - val_loss: 4.3302
Epoch 89/100
18/18 [==============================] - 0s 13ms/step - loss: 5.0152 - val_loss: 4.7046
Epoch 90/100
18/18 [==============================] - 0s 12ms/step - loss: 5.0139 - val_loss: 5.0179
Epoch 91/100
18/18 [==============================] - 0s 14ms/step - loss: 4.5883 - val_loss: 4.4400
Epoch 92/100
18/18 [==============================] - 0s 13ms/step - loss: 4.5470 - val_loss: 4.5817
Epoch 93/100
18/18 [==============================] - 0s 14ms/step - loss: 4.6947 - val_loss: 4.6107
Epoch 94/100
18/18 [==============================] - 0s 14ms/step - loss: 4.8942 - val_loss: 6.1996
Epoch 95/100
18/18 [==============================] - 0s 13ms/step - loss: 4.7728 - val_loss: 4.4305
Epoch 96/100
18/18 [==============================] - 0s 13ms/step - loss: 4.8579 - val_loss: 4.2354
Epoch 97/100
18/18 [==============================] - 0s 13ms/step - loss: 4.4133 - val_loss: 4.5240
Epoch 98/100
18/18 [==============================] - 0s 13ms/step - loss: 4.4848 - val_loss: 4.5561
Epoch 99/100
18/18 [==============================] - 0s 14ms/step - loss: 4.4528 - val_loss: 4.5463
Epoch 100/100
18/18 [==============================] - 0s 12ms/step - loss: 4.3394 - val_loss: 4.3727
Epoch 1/100
34/34 [==============================] - 2s 29ms/step - loss: 39.0190 - val_loss: 43.4020
Epoch 2/100
34/34 [==============================] - 0s 11ms/step - loss: 38.2375 - val_loss: 41.7660
Epoch 3/100
34/34 [==============================] - 0s 8ms/step - loss: 34.5784 - val_loss: 36.0678
Epoch 4/100
34/34 [==============================] - 0s 8ms/step - loss: 30.7581 - val_loss: 33.4651
Epoch 5/100
34/34 [==============================] - 0s 8ms/step - loss: 28.9258 - val_loss: 31.8328
Epoch 6/100
34/34 [==============================] - 0s 8ms/step - loss: 27.6563 - val_loss: 30.4771
Epoch 7/100
34/34 [==============================] - 0s 8ms/step - loss: 26.5291 - val_loss: 29.2494
Epoch 8/100
34/34 [==============================] - 0s 9ms/step - loss: 25.1485 - val_loss: 29.6903
Epoch 9/100
34/34 [==============================] - 0s 8ms/step - loss: 24.7778 - val_loss: 27.0269
Epoch 10/100
34/34 [==============================] - 0s 9ms/step - loss: 22.8250 - val_loss: 26.0634
Epoch 11/100
34/34 [==============================] - 0s 9ms/step - loss: 21.8224 - val_loss: 24.7760
Epoch 12/100
34/34 [==============================] - 0s 8ms/step - loss: 20.8131 - val_loss: 23.8068
Epoch 13/100
34/34 [==============================] - 0s 9ms/step - loss: 19.7318 - val_loss: 22.7168
Epoch 14/100
34/34 [==============================] - 0s 8ms/step - loss: 18.6247 - val_loss: 21.5563
Epoch 15/100
34/34 [==============================] - 0s 9ms/step - loss: 17.5744 - val_loss: 20.4818
Epoch 16/100
34/34 [==============================] - 0s 9ms/step - loss: 16.6553 - val_loss: 19.5099
Epoch 17/100
34/34 [==============================] - 0s 8ms/step - loss: 15.6285 - val_loss: 18.3604
Epoch 18/100
34/34 [==============================] - 0s 9ms/step - loss: 14.8943 - val_loss: 17.3230
Epoch 19/100
34/34 [==============================] - 0s 8ms/step - loss: 14.0730 - val_loss: 16.4492
Epoch 20/100
34/34 [==============================] - 0s 9ms/step - loss: 13.3879 - val_loss: 15.7189
Epoch 21/100
34/34 [==============================] - 0s 9ms/step - loss: 12.6895 - val_loss: 14.8992
Epoch 22/100
34/34 [==============================] - 0s 8ms/step - loss: 11.7742 - val_loss: 14.0806
Epoch 23/100
34/34 [==============================] - 0s 9ms/step - loss: 11.1841 - val_loss: 13.1591
Epoch 24/100
34/34 [==============================] - 0s 9ms/step - loss: 10.2250 - val_loss: 12.7324
Epoch 25/100
34/34 [==============================] - 0s 9ms/step - loss: 9.8636 - val_loss: 11.6659
Epoch 26/100
34/34 [==============================] - 0s 9ms/step - loss: 9.2617 - val_loss: 11.0175
Epoch 27/100
34/34 [==============================] - 0s 9ms/step - loss: 8.6025 - val_loss: 10.5029
Epoch 28/100
34/34 [==============================] - 0s 10ms/step - loss: 8.1542 - val_loss: 9.9416
Epoch 29/100
34/34 [==============================] - 0s 10ms/step - loss: 7.8522 - val_loss: 9.4328
Epoch 30/100
34/34 [==============================] - 0s 10ms/step - loss: 7.4979 - val_loss: 9.4981
Epoch 31/100
34/34 [==============================] - 0s 12ms/step - loss: 7.2984 - val_loss: 8.5088
Epoch 32/100
34/34 [==============================] - 0s 12ms/step - loss: 6.5543 - val_loss: 7.9387
Epoch 33/100
34/34 [==============================] - 0s 12ms/step - loss: 6.2962 - val_loss: 7.6839
Epoch 34/100
34/34 [==============================] - 0s 12ms/step - loss: 6.2880 - val_loss: 7.3443
Epoch 35/100
34/34 [==============================] - 0s 12ms/step - loss: 6.0811 - val_loss: 6.8853
Epoch 36/100
34/34 [==============================] - 0s 9ms/step - loss: 5.5798 - val_loss: 6.7458
Epoch 37/100
34/34 [==============================] - 0s 9ms/step - loss: 5.9652 - val_loss: 6.2510
Epoch 38/100
34/34 [==============================] - 0s 9ms/step - loss: 5.5112 - val_loss: 6.0074
Epoch 39/100
34/34 [==============================] - 0s 9ms/step - loss: 5.4674 - val_loss: 6.0356
Epoch 40/100
34/34 [==============================] - 0s 9ms/step - loss: 5.6078 - val_loss: 5.5673
Epoch 41/100
34/34 [==============================] - 0s 9ms/step - loss: 5.0992 - val_loss: 5.6725
Epoch 42/100
34/34 [==============================] - 0s 9ms/step - loss: 5.5073 - val_loss: 5.1505
Epoch 43/100
34/34 [==============================] - 0s 9ms/step - loss: 5.0009 - val_loss: 5.2072
Epoch 44/100
34/34 [==============================] - 0s 9ms/step - loss: 4.8148 - val_loss: 4.9650
Epoch 45/100
34/34 [==============================] - 0s 9ms/step - loss: 4.7484 - val_loss: 4.7239
Epoch 46/100
34/34 [==============================] - 0s 9ms/step - loss: 4.7272 - val_loss: 4.5964
Epoch 47/100
34/34 [==============================] - 0s 9ms/step - loss: 4.4639 - val_loss: 4.2412
Epoch 48/100
34/34 [==============================] - 0s 9ms/step - loss: 4.3904 - val_loss: 4.0470
Epoch 49/100
34/34 [==============================] - 0s 9ms/step - loss: 4.2279 - val_loss: 3.8053
Epoch 50/100
34/34 [==============================] - 0s 10ms/step - loss: 4.1347 - val_loss: 3.8602
Epoch 51/100
34/34 [==============================] - 0s 9ms/step - loss: 4.0747 - val_loss: 3.5167
Epoch 52/100
34/34 [==============================] - 0s 10ms/step - loss: 4.0338 - val_loss: 3.7114
Epoch 53/100
34/34 [==============================] - 0s 9ms/step - loss: 3.9180 - val_loss: 3.5748
Epoch 54/100
34/34 [==============================] - 0s 10ms/step - loss: 3.8399 - val_loss: 3.4900
Epoch 55/100
34/34 [==============================] - 0s 10ms/step - loss: 4.0482 - val_loss: 3.5192
Epoch 56/100
34/34 [==============================] - 0s 9ms/step - loss: 3.9308 - val_loss: 2.9771
Epoch 57/100
34/34 [==============================] - 0s 9ms/step - loss: 3.7876 - val_loss: 3.7819
Epoch 58/100
34/34 [==============================] - 0s 9ms/step - loss: 3.7984 - val_loss: 2.8240
Epoch 59/100
34/34 [==============================] - 0s 9ms/step - loss: 3.8048 - val_loss: 2.7703
Epoch 60/100
34/34 [==============================] - 0s 9ms/step - loss: 3.7766 - val_loss: 2.8543
Epoch 61/100
34/34 [==============================] - 0s 11ms/step - loss: 3.6802 - val_loss: 2.7243
Epoch 62/100
34/34 [==============================] - 0s 9ms/step - loss: 3.6197 - val_loss: 2.7021
Epoch 63/100
34/34 [==============================] - 0s 11ms/step - loss: 3.6375 - val_loss: 2.7411
Epoch 64/100
34/34 [==============================] - 0s 9ms/step - loss: 3.7570 - val_loss: 2.5426
Epoch 65/100
34/34 [==============================] - 0s 10ms/step - loss: 3.6345 - val_loss: 2.7003
Epoch 66/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4758 - val_loss: 3.6186
Epoch 67/100
34/34 [==============================] - 0s 9ms/step - loss: 3.5264 - val_loss: 2.5363
Epoch 68/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4594 - val_loss: 2.7591
Epoch 69/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4564 - val_loss: 2.4600
Epoch 70/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4382 - val_loss: 2.8051
Epoch 71/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4694 - val_loss: 2.7566
Epoch 72/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4579 - val_loss: 2.9144
Epoch 73/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4241 - val_loss: 2.5326
Epoch 74/100
34/34 [==============================] - 0s 9ms/step - loss: 3.5896 - val_loss: 2.4089
Epoch 75/100
34/34 [==============================] - 0s 10ms/step - loss: 3.3982 - val_loss: 2.1410
Epoch 76/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4484 - val_loss: 2.1725
Epoch 77/100
34/34 [==============================] - 0s 9ms/step - loss: 3.3452 - val_loss: 2.2577
Epoch 78/100
34/34 [==============================] - 0s 9ms/step - loss: 3.2403 - val_loss: 2.3211
Epoch 79/100
34/34 [==============================] - 0s 9ms/step - loss: 3.2744 - val_loss: 2.1928
Epoch 80/100
34/34 [==============================] - 0s 9ms/step - loss: 3.4103 - val_loss: 2.2520
Epoch 81/100
34/34 [==============================] - 0s 9ms/step - loss: 3.3506 - val_loss: 2.5705
Epoch 82/100
34/34 [==============================] - 0s 9ms/step - loss: 3.1907 - val_loss: 2.8163
Epoch 83/100
34/34 [==============================] - 0s 9ms/step - loss: 3.2884 - val_loss: 1.9566
Epoch 84/100
34/34 [==============================] - 0s 10ms/step - loss: 3.2021 - val_loss: 2.1950
Epoch 85/100
34/34 [==============================] - 0s 9ms/step - loss: 3.2084 - val_loss: 3.2727
Epoch 86/100
34/34 [==============================] - 0s 9ms/step - loss: 3.3715 - val_loss: 2.9904
Epoch 87/100
34/34 [==============================] - 0s 9ms/step - loss: 3.1373 - val_loss: 2.5920
Epoch 88/100
34/34 [==============================] - 0s 9ms/step - loss: 3.2892 - val_loss: 2.1110
Epoch 89/100
34/34 [==============================] - 0s 9ms/step - loss: 3.1956 - val_loss: 2.3399
Epoch 90/100
34/34 [==============================] - 0s 9ms/step - loss: 3.3929 - val_loss: 2.7149
Epoch 91/100
34/34 [==============================] - 0s 9ms/step - loss: 3.1536 - val_loss: 1.9961
Epoch 92/100
34/34 [==============================] - 0s 9ms/step - loss: 3.1579 - val_loss: 2.4372
Epoch 93/100
34/34 [==============================] - 0s 9ms/step - loss: 3.2152 - val_loss: 2.4803
Epoch 94/100
34/34 [==============================] - 0s 12ms/step - loss: 3.3224 - val_loss: 2.5414
Epoch 95/100
34/34 [==============================] - 0s 13ms/step - loss: 3.3640 - val_loss: 2.6750
Epoch 96/100
34/34 [==============================] - 0s 13ms/step - loss: 3.0992 - val_loss: 1.9718
Epoch 97/100
34/34 [==============================] - 0s 12ms/step - loss: 3.3142 - val_loss: 2.4305
Epoch 98/100
34/34 [==============================] - 0s 12ms/step - loss: 3.2310 - val_loss: 1.7763
Epoch 99/100
34/34 [==============================] - 0s 10ms/step - loss: 3.1329 - val_loss: 2.2274
Epoch 100/100
34/34 [==============================] - 0s 9ms/step - loss: 3.1485 - val_loss: 2.6304
Epoch 1/100
51/51 [==============================] - 5s 28ms/step - loss: 40.3986 - val_loss: 44.9189
Epoch 2/100
51/51 [==============================] - 1s 12ms/step - loss: 37.4749 - val_loss: 38.4402
Epoch 3/100
51/51 [==============================] - 1s 12ms/step - loss: 31.6560 - val_loss: 34.7218
Epoch 4/100
51/51 [==============================] - 1s 12ms/step - loss: 28.9240 - val_loss: 32.4463
Epoch 5/100
51/51 [==============================] - 1s 14ms/step - loss: 26.8911 - val_loss: 30.5334
Epoch 6/100
51/51 [==============================] - 1s 13ms/step - loss: 24.8892 - val_loss: 29.1490
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 23.3618 - val_loss: 27.3700
Epoch 8/100
51/51 [==============================] - 1s 18ms/step - loss: 21.6673 - val_loss: 25.7280
Epoch 9/100
51/51 [==============================] - 1s 16ms/step - loss: 20.1154 - val_loss: 24.1361
Epoch 10/100
51/51 [==============================] - 1s 21ms/step - loss: 18.7405 - val_loss: 22.3047
Epoch 11/100
51/51 [==============================] - 1s 21ms/step - loss: 17.1788 - val_loss: 21.1177
Epoch 12/100
51/51 [==============================] - 1s 19ms/step - loss: 15.8566 - val_loss: 19.4396
Epoch 13/100
51/51 [==============================] - 1s 18ms/step - loss: 14.6262 - val_loss: 18.0319
Epoch 14/100
51/51 [==============================] - 1s 23ms/step - loss: 13.4847 - val_loss: 16.9886
Epoch 15/100
51/51 [==============================] - 1s 25ms/step - loss: 12.3024 - val_loss: 15.5389
Epoch 16/100
51/51 [==============================] - 1s 21ms/step - loss: 11.1308 - val_loss: 14.3780
Epoch 17/100
51/51 [==============================] - 1s 17ms/step - loss: 10.1377 - val_loss: 13.5340
Epoch 18/100
51/51 [==============================] - 1s 15ms/step - loss: 9.5130 - val_loss: 12.2682
Epoch 19/100
51/51 [==============================] - 1s 13ms/step - loss: 9.0545 - val_loss: 11.6747
Epoch 20/100
51/51 [==============================] - 1s 18ms/step - loss: 8.0146 - val_loss: 10.6073
Epoch 21/100
51/51 [==============================] - 1s 17ms/step - loss: 7.6159 - val_loss: 9.6321
Epoch 22/100
51/51 [==============================] - 1s 15ms/step - loss: 6.9981 - val_loss: 9.0747
Epoch 23/100
51/51 [==============================] - 1s 15ms/step - loss: 6.3338 - val_loss: 8.4396
Epoch 24/100
51/51 [==============================] - 1s 14ms/step - loss: 5.8715 - val_loss: 8.3721
Epoch 25/100
51/51 [==============================] - 1s 13ms/step - loss: 5.8153 - val_loss: 7.9296
Epoch 26/100
51/51 [==============================] - 1s 13ms/step - loss: 5.5722 - val_loss: 7.0349
Epoch 27/100
51/51 [==============================] - 1s 14ms/step - loss: 5.4090 - val_loss: 6.5579
Epoch 28/100
51/51 [==============================] - 1s 13ms/step - loss: 5.1493 - val_loss: 6.6998
Epoch 29/100
51/51 [==============================] - 1s 13ms/step - loss: 5.1297 - val_loss: 6.3087
Epoch 30/100
51/51 [==============================] - 1s 14ms/step - loss: 4.7725 - val_loss: 5.7992
Epoch 31/100
51/51 [==============================] - 1s 14ms/step - loss: 4.5853 - val_loss: 5.3255
Epoch 32/100
51/51 [==============================] - 1s 14ms/step - loss: 4.3277 - val_loss: 4.9773
Epoch 33/100
51/51 [==============================] - 1s 18ms/step - loss: 4.3045 - val_loss: 4.9143
Epoch 34/100
51/51 [==============================] - 1s 17ms/step - loss: 4.1827 - val_loss: 4.5669
Epoch 35/100
51/51 [==============================] - 1s 19ms/step - loss: 4.1527 - val_loss: 4.5839
Epoch 36/100
51/51 [==============================] - 1s 17ms/step - loss: 4.1228 - val_loss: 4.2651
Epoch 37/100
51/51 [==============================] - 1s 14ms/step - loss: 4.1367 - val_loss: 4.0370
Epoch 38/100
51/51 [==============================] - 1s 14ms/step - loss: 3.9257 - val_loss: 3.8924
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 3.8582 - val_loss: 3.9037
Epoch 40/100
51/51 [==============================] - 1s 14ms/step - loss: 3.8348 - val_loss: 3.8392
Epoch 41/100
51/51 [==============================] - 1s 14ms/step - loss: 3.8893 - val_loss: 3.5390
Epoch 42/100
51/51 [==============================] - 1s 14ms/step - loss: 3.6878 - val_loss: 3.3492
Epoch 43/100
51/51 [==============================] - 1s 15ms/step - loss: 3.7741 - val_loss: 3.5122
Epoch 44/100
51/51 [==============================] - 1s 13ms/step - loss: 3.8425 - val_loss: 3.2546
Epoch 45/100
51/51 [==============================] - 1s 14ms/step - loss: 3.6786 - val_loss: 3.0542
Epoch 46/100
51/51 [==============================] - 1s 17ms/step - loss: 3.6954 - val_loss: 3.1218
Epoch 47/100
51/51 [==============================] - 1s 17ms/step - loss: 3.6503 - val_loss: 2.9320
Epoch 48/100
51/51 [==============================] - 1s 18ms/step - loss: 3.5772 - val_loss: 2.9808
Epoch 49/100
51/51 [==============================] - 1s 14ms/step - loss: 3.6449 - val_loss: 2.8739
Epoch 50/100
51/51 [==============================] - 1s 13ms/step - loss: 3.5737 - val_loss: 2.7347
Epoch 51/100
51/51 [==============================] - 1s 16ms/step - loss: 3.4517 - val_loss: 2.7400
Epoch 52/100
51/51 [==============================] - 1s 20ms/step - loss: 3.5879 - val_loss: 2.5617
Epoch 53/100
51/51 [==============================] - 1s 20ms/step - loss: 3.6435 - val_loss: 2.6707
Epoch 54/100
51/51 [==============================] - 1s 19ms/step - loss: 3.5753 - val_loss: 2.6168
Epoch 55/100
51/51 [==============================] - 1s 18ms/step - loss: 3.3301 - val_loss: 2.6690
Epoch 56/100
51/51 [==============================] - 1s 17ms/step - loss: 3.4624 - val_loss: 2.4522
Epoch 57/100
51/51 [==============================] - 1s 17ms/step - loss: 3.6605 - val_loss: 2.8089
Epoch 58/100
51/51 [==============================] - 1s 17ms/step - loss: 3.4729 - val_loss: 2.3914
Epoch 59/100
51/51 [==============================] - 1s 16ms/step - loss: 3.5275 - val_loss: 2.4312
Epoch 60/100
51/51 [==============================] - 1s 14ms/step - loss: 3.4769 - val_loss: 2.4377
Epoch 61/100
51/51 [==============================] - 1s 15ms/step - loss: 3.4507 - val_loss: 2.7232
Epoch 62/100
51/51 [==============================] - 1s 14ms/step - loss: 3.5550 - val_loss: 2.3585
Epoch 63/100
51/51 [==============================] - 1s 14ms/step - loss: 3.4554 - val_loss: 2.5045
Epoch 64/100
51/51 [==============================] - 1s 14ms/step - loss: 3.3885 - val_loss: 2.3254
Epoch 65/100
51/51 [==============================] - 1s 13ms/step - loss: 3.4383 - val_loss: 2.3441
Epoch 66/100
51/51 [==============================] - 1s 12ms/step - loss: 3.3496 - val_loss: 2.4230
Epoch 67/100
51/51 [==============================] - 1s 12ms/step - loss: 3.2959 - val_loss: 2.3627
Epoch 68/100
51/51 [==============================] - 1s 15ms/step - loss: 3.3959 - val_loss: 2.1905
Epoch 69/100
51/51 [==============================] - 1s 19ms/step - loss: 3.3776 - val_loss: 2.3116
Epoch 70/100
51/51 [==============================] - 1s 18ms/step - loss: 3.3861 - val_loss: 2.5639
Epoch 71/100
51/51 [==============================] - 1s 21ms/step - loss: 3.3191 - val_loss: 2.2740
Epoch 72/100
51/51 [==============================] - 1s 19ms/step - loss: 3.2944 - val_loss: 2.3874
Epoch 73/100
51/51 [==============================] - 1s 20ms/step - loss: 3.4689 - val_loss: 2.3099
Epoch 74/100
51/51 [==============================] - 1s 21ms/step - loss: 3.3785 - val_loss: 2.4289
Epoch 75/100
51/51 [==============================] - 1s 18ms/step - loss: 3.3310 - val_loss: 2.2315
Epoch 76/100
51/51 [==============================] - 1s 17ms/step - loss: 3.3726 - val_loss: 2.1551
Epoch 77/100
51/51 [==============================] - 1s 16ms/step - loss: 3.4084 - val_loss: 2.4392
Epoch 78/100
51/51 [==============================] - 1s 12ms/step - loss: 3.4535 - val_loss: 2.4196
Epoch 79/100
51/51 [==============================] - 1s 12ms/step - loss: 3.4610 - val_loss: 2.5213
Epoch 80/100
51/51 [==============================] - 1s 13ms/step - loss: 3.2918 - val_loss: 2.0777
Epoch 81/100
51/51 [==============================] - 1s 13ms/step - loss: 3.2780 - val_loss: 2.4712
Epoch 82/100
51/51 [==============================] - 1s 13ms/step - loss: 3.3504 - val_loss: 2.2025
Epoch 83/100
51/51 [==============================] - 1s 13ms/step - loss: 3.2925 - val_loss: 2.2916
Epoch 84/100
51/51 [==============================] - 1s 13ms/step - loss: 3.2267 - val_loss: 2.2146
Epoch 85/100
51/51 [==============================] - 1s 16ms/step - loss: 3.2516 - val_loss: 2.0431
Epoch 86/100
51/51 [==============================] - 1s 17ms/step - loss: 3.3462 - val_loss: 2.0940
Epoch 87/100
51/51 [==============================] - 1s 16ms/step - loss: 3.2293 - val_loss: 2.0175
Epoch 88/100
51/51 [==============================] - 1s 14ms/step - loss: 3.3400 - val_loss: 2.0474
Epoch 89/100
51/51 [==============================] - 1s 13ms/step - loss: 3.3145 - val_loss: 2.4469
Epoch 90/100
51/51 [==============================] - 1s 12ms/step - loss: 3.2736 - val_loss: 2.0645
Epoch 91/100
51/51 [==============================] - 1s 12ms/step - loss: 3.2381 - val_loss: 2.0520
Epoch 92/100
51/51 [==============================] - 1s 12ms/step - loss: 3.3641 - val_loss: 2.3631
Epoch 93/100
51/51 [==============================] - 1s 12ms/step - loss: 3.1238 - val_loss: 2.0694
Epoch 94/100
51/51 [==============================] - 1s 14ms/step - loss: 3.1312 - val_loss: 2.1617
Epoch 95/100
51/51 [==============================] - 1s 13ms/step - loss: 3.2503 - val_loss: 1.8919
Epoch 96/100
51/51 [==============================] - 1s 13ms/step - loss: 3.1630 - val_loss: 2.1377
Epoch 97/100
51/51 [==============================] - 1s 13ms/step - loss: 3.0188 - val_loss: 2.2807
Epoch 98/100
51/51 [==============================] - 1s 14ms/step - loss: 3.1834 - val_loss: 2.4196
Epoch 99/100
51/51 [==============================] - 1s 13ms/step - loss: 3.2415 - val_loss: 1.9734
Epoch 100/100
51/51 [==============================] - 1s 13ms/step - loss: 3.1717 - val_loss: 2.0537
Epoch 1/100
68/68 [==============================] - 3s 19ms/step - loss: 41.3741 - val_loss: 39.0208
Epoch 2/100
68/68 [==============================] - 1s 11ms/step - loss: 35.4271 - val_loss: 31.0833
Epoch 3/100
68/68 [==============================] - 1s 11ms/step - loss: 30.9213 - val_loss: 28.0394
Epoch 4/100
68/68 [==============================] - 1s 12ms/step - loss: 28.3255 - val_loss: 25.6062
Epoch 5/100
68/68 [==============================] - 1s 12ms/step - loss: 26.1840 - val_loss: 23.4750
Epoch 6/100
68/68 [==============================] - 1s 12ms/step - loss: 24.1526 - val_loss: 21.5241
Epoch 7/100
68/68 [==============================] - 1s 12ms/step - loss: 22.2026 - val_loss: 19.3524
Epoch 8/100
68/68 [==============================] - 1s 12ms/step - loss: 19.9106 - val_loss: 17.2850
Epoch 9/100
68/68 [==============================] - 1s 16ms/step - loss: 17.8885 - val_loss: 15.4652
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 16.2585 - val_loss: 13.7734
Epoch 11/100
68/68 [==============================] - 1s 16ms/step - loss: 14.4460 - val_loss: 12.3996
Epoch 12/100
68/68 [==============================] - 1s 16ms/step - loss: 12.8364 - val_loss: 11.0882
Epoch 13/100
68/68 [==============================] - 1s 12ms/step - loss: 11.5209 - val_loss: 10.1739
Epoch 14/100
68/68 [==============================] - 1s 12ms/step - loss: 10.4642 - val_loss: 8.8522
Epoch 15/100
68/68 [==============================] - 1s 12ms/step - loss: 9.2461 - val_loss: 7.6373
Epoch 16/100
68/68 [==============================] - 1s 12ms/step - loss: 8.4067 - val_loss: 6.7814
Epoch 17/100
68/68 [==============================] - 1s 13ms/step - loss: 7.6471 - val_loss: 6.1728
Epoch 18/100
68/68 [==============================] - 1s 12ms/step - loss: 6.8060 - val_loss: 5.5979
Epoch 19/100
68/68 [==============================] - 1s 12ms/step - loss: 6.5091 - val_loss: 5.4874
Epoch 20/100
68/68 [==============================] - 1s 12ms/step - loss: 6.0092 - val_loss: 5.5325
Epoch 21/100
68/68 [==============================] - 1s 12ms/step - loss: 5.8087 - val_loss: 4.6169
Epoch 22/100
68/68 [==============================] - 1s 12ms/step - loss: 5.4931 - val_loss: 4.1249
Epoch 23/100
68/68 [==============================] - 1s 12ms/step - loss: 5.1242 - val_loss: 3.9577
Epoch 24/100
68/68 [==============================] - 1s 12ms/step - loss: 4.8453 - val_loss: 3.7010
Epoch 25/100
68/68 [==============================] - 1s 13ms/step - loss: 4.6976 - val_loss: 3.4138
Epoch 26/100
68/68 [==============================] - 1s 12ms/step - loss: 4.4393 - val_loss: 3.2844
Epoch 27/100
68/68 [==============================] - 1s 12ms/step - loss: 4.3309 - val_loss: 2.9263
Epoch 28/100
68/68 [==============================] - 1s 12ms/step - loss: 4.1556 - val_loss: 2.9857
Epoch 29/100
68/68 [==============================] - 1s 12ms/step - loss: 4.2372 - val_loss: 2.9885
Epoch 30/100
68/68 [==============================] - 1s 12ms/step - loss: 4.0847 - val_loss: 2.4251
Epoch 31/100
68/68 [==============================] - 1s 12ms/step - loss: 3.8122 - val_loss: 2.4491
Epoch 32/100
68/68 [==============================] - 1s 13ms/step - loss: 3.8742 - val_loss: 2.6154
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 3.7867 - val_loss: 2.4860
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 3.7030 - val_loss: 2.4982
Epoch 35/100
68/68 [==============================] - 1s 12ms/step - loss: 3.7587 - val_loss: 2.8331
Epoch 36/100
68/68 [==============================] - 1s 12ms/step - loss: 3.6342 - val_loss: 2.4667
Epoch 37/100
68/68 [==============================] - 1s 11ms/step - loss: 3.6651 - val_loss: 2.5862
Epoch 38/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5500 - val_loss: 2.4261
Epoch 39/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5727 - val_loss: 2.6655
Epoch 40/100
68/68 [==============================] - 1s 11ms/step - loss: 3.7005 - val_loss: 2.2716
Epoch 41/100
68/68 [==============================] - 1s 12ms/step - loss: 3.6480 - val_loss: 2.4858
Epoch 42/100
68/68 [==============================] - 1s 12ms/step - loss: 3.5104 - val_loss: 2.7581
Epoch 43/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5732 - val_loss: 2.3902
Epoch 44/100
68/68 [==============================] - 1s 12ms/step - loss: 3.5398 - val_loss: 2.1827
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 3.6158 - val_loss: 2.0044
Epoch 46/100
68/68 [==============================] - 1s 17ms/step - loss: 3.6082 - val_loss: 2.0777
Epoch 47/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4461 - val_loss: 2.2385
Epoch 48/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5960 - val_loss: 2.0981
Epoch 49/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5315 - val_loss: 2.3408
Epoch 50/100
68/68 [==============================] - 1s 11ms/step - loss: 3.4611 - val_loss: 2.5463
Epoch 51/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5037 - val_loss: 2.1192
Epoch 52/100
68/68 [==============================] - 1s 11ms/step - loss: 3.4990 - val_loss: 2.3237
Epoch 53/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4692 - val_loss: 2.1170
Epoch 54/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3467 - val_loss: 2.0941
Epoch 55/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4314 - val_loss: 2.1715
Epoch 56/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2547 - val_loss: 2.1993
Epoch 57/100
68/68 [==============================] - 1s 12ms/step - loss: 3.5063 - val_loss: 2.0224
Epoch 58/100
68/68 [==============================] - 1s 12ms/step - loss: 3.3851 - val_loss: 2.3489
Epoch 59/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2549 - val_loss: 2.2169
Epoch 60/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4230 - val_loss: 2.1499
Epoch 61/100
68/68 [==============================] - 1s 12ms/step - loss: 3.3569 - val_loss: 2.1151
Epoch 62/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3209 - val_loss: 1.7524
Epoch 63/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2705 - val_loss: 2.0736
Epoch 64/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2785 - val_loss: 1.8567
Epoch 65/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4309 - val_loss: 2.0271
Epoch 66/100
68/68 [==============================] - 1s 14ms/step - loss: 3.3349 - val_loss: 2.1910
Epoch 67/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3630 - val_loss: 2.1321
Epoch 68/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2718 - val_loss: 2.0899
Epoch 69/100
68/68 [==============================] - 1s 14ms/step - loss: 3.3674 - val_loss: 2.0311
Epoch 70/100
68/68 [==============================] - 1s 15ms/step - loss: 3.3130 - val_loss: 2.1585
Epoch 71/100
68/68 [==============================] - 1s 15ms/step - loss: 3.3513 - val_loss: 2.0220
Epoch 72/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2311 - val_loss: 2.3323
Epoch 73/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3204 - val_loss: 2.1309
Epoch 74/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2647 - val_loss: 2.1125
Epoch 75/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3674 - val_loss: 1.9299
Epoch 76/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3852 - val_loss: 1.7248
Epoch 77/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2987 - val_loss: 2.0475
Epoch 78/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2897 - val_loss: 1.9580
Epoch 79/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2749 - val_loss: 2.0681
Epoch 80/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2719 - val_loss: 2.1533
Epoch 81/100
68/68 [==============================] - 1s 17ms/step - loss: 3.1759 - val_loss: 1.9394
Epoch 82/100
68/68 [==============================] - 1s 16ms/step - loss: 3.1978 - val_loss: 1.9696
Epoch 83/100
68/68 [==============================] - 1s 16ms/step - loss: 3.2335 - val_loss: 2.1528
Epoch 84/100
68/68 [==============================] - 1s 12ms/step - loss: 3.1784 - val_loss: 1.9344
Epoch 85/100
68/68 [==============================] - 1s 12ms/step - loss: 3.1972 - val_loss: 2.2742
Epoch 86/100
68/68 [==============================] - 1s 13ms/step - loss: 3.1721 - val_loss: 2.1799
Epoch 87/100
68/68 [==============================] - 1s 13ms/step - loss: 3.2170 - val_loss: 1.8111
Epoch 88/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2500 - val_loss: 2.0240
Epoch 89/100
68/68 [==============================] - 1s 13ms/step - loss: 3.2055 - val_loss: 1.9300
Epoch 90/100
68/68 [==============================] - 1s 13ms/step - loss: 3.1900 - val_loss: 1.7681
Epoch 91/100
68/68 [==============================] - 1s 12ms/step - loss: 3.1974 - val_loss: 1.8980
Epoch 92/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2011 - val_loss: 1.7647
Epoch 93/100
68/68 [==============================] - 1s 13ms/step - loss: 3.2324 - val_loss: 1.9307
Epoch 94/100
68/68 [==============================] - 1s 15ms/step - loss: 3.1037 - val_loss: 2.0384
Epoch 95/100
68/68 [==============================] - 1s 13ms/step - loss: 3.1662 - val_loss: 1.9949
Epoch 96/100
68/68 [==============================] - 1s 14ms/step - loss: 3.3538 - val_loss: 2.5795
Epoch 97/100
68/68 [==============================] - 1s 14ms/step - loss: 3.2106 - val_loss: 1.8488
Epoch 98/100
68/68 [==============================] - 1s 14ms/step - loss: 3.1821 - val_loss: 2.0333
Epoch 99/100
68/68 [==============================] - 1s 14ms/step - loss: 3.1218 - val_loss: 1.8472
Epoch 100/100
68/68 [==============================] - 1s 14ms/step - loss: 3.2190 - val_loss: 1.6719
Epoch 1/100
85/85 [==============================] - 4s 23ms/step - loss: 39.9653 - val_loss: 37.1757
Epoch 2/100
85/85 [==============================] - 1s 12ms/step - loss: 31.3266 - val_loss: 31.2456
Epoch 3/100
85/85 [==============================] - 1s 11ms/step - loss: 27.5042 - val_loss: 28.1528
Epoch 4/100
85/85 [==============================] - 1s 12ms/step - loss: 24.7661 - val_loss: 25.5283
Epoch 5/100
85/85 [==============================] - 1s 11ms/step - loss: 22.4229 - val_loss: 22.9251
Epoch 6/100
85/85 [==============================] - 1s 11ms/step - loss: 20.0313 - val_loss: 20.5135
Epoch 7/100
85/85 [==============================] - 1s 12ms/step - loss: 17.9038 - val_loss: 18.0862
Epoch 8/100
85/85 [==============================] - 1s 12ms/step - loss: 15.3808 - val_loss: 15.8206
Epoch 9/100
85/85 [==============================] - 1s 12ms/step - loss: 13.4633 - val_loss: 14.1317
Epoch 10/100
85/85 [==============================] - 1s 13ms/step - loss: 11.7013 - val_loss: 11.8835
Epoch 11/100
85/85 [==============================] - 1s 16ms/step - loss: 10.1864 - val_loss: 9.8489
Epoch 12/100
85/85 [==============================] - 1s 13ms/step - loss: 8.7482 - val_loss: 8.5482
Epoch 13/100
85/85 [==============================] - 1s 12ms/step - loss: 7.6142 - val_loss: 7.3647
Epoch 14/100
85/85 [==============================] - 1s 11ms/step - loss: 6.7742 - val_loss: 6.4122
Epoch 15/100
85/85 [==============================] - 1s 12ms/step - loss: 6.1427 - val_loss: 5.8699
Epoch 16/100
85/85 [==============================] - 1s 14ms/step - loss: 5.6075 - val_loss: 5.0487
Epoch 17/100
85/85 [==============================] - 1s 12ms/step - loss: 5.2592 - val_loss: 4.6364
Epoch 18/100
85/85 [==============================] - 1s 12ms/step - loss: 5.1197 - val_loss: 4.4476
Epoch 19/100
85/85 [==============================] - 1s 13ms/step - loss: 4.6206 - val_loss: 4.1555
Epoch 20/100
85/85 [==============================] - 1s 11ms/step - loss: 4.4267 - val_loss: 3.7178
Epoch 21/100
85/85 [==============================] - 1s 11ms/step - loss: 4.3344 - val_loss: 3.6455
Epoch 22/100
85/85 [==============================] - 1s 10ms/step - loss: 4.2677 - val_loss: 3.2970
Epoch 23/100
85/85 [==============================] - 1s 10ms/step - loss: 3.9154 - val_loss: 3.7783
Epoch 24/100
85/85 [==============================] - 1s 10ms/step - loss: 3.9392 - val_loss: 2.8976
Epoch 25/100
85/85 [==============================] - 1s 11ms/step - loss: 3.9164 - val_loss: 3.1914
Epoch 26/100
85/85 [==============================] - 1s 11ms/step - loss: 3.7197 - val_loss: 2.7461
Epoch 27/100
85/85 [==============================] - 1s 12ms/step - loss: 3.7901 - val_loss: 2.9936
Epoch 28/100
85/85 [==============================] - 1s 11ms/step - loss: 3.7201 - val_loss: 2.4624
Epoch 29/100
85/85 [==============================] - 1s 11ms/step - loss: 3.6650 - val_loss: 2.4512
Epoch 30/100
85/85 [==============================] - 1s 11ms/step - loss: 3.6826 - val_loss: 2.1564
Epoch 31/100
85/85 [==============================] - 1s 14ms/step - loss: 3.5367 - val_loss: 2.5484
Epoch 32/100
85/85 [==============================] - 1s 15ms/step - loss: 3.7178 - val_loss: 2.1624
Epoch 33/100
85/85 [==============================] - 1s 12ms/step - loss: 3.5225 - val_loss: 2.3259
Epoch 34/100
85/85 [==============================] - 1s 11ms/step - loss: 3.5961 - val_loss: 2.0665
Epoch 35/100
85/85 [==============================] - 1s 13ms/step - loss: 3.4534 - val_loss: 2.1941
Epoch 36/100
85/85 [==============================] - 1s 12ms/step - loss: 3.5689 - val_loss: 1.9571
Epoch 37/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4737 - val_loss: 2.4024
Epoch 38/100
85/85 [==============================] - 1s 13ms/step - loss: 3.5436 - val_loss: 2.1821
Epoch 39/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4158 - val_loss: 2.3103
Epoch 40/100
85/85 [==============================] - 1s 13ms/step - loss: 3.3831 - val_loss: 2.1581
Epoch 41/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4485 - val_loss: 2.3076
Epoch 42/100
85/85 [==============================] - 1s 12ms/step - loss: 3.5233 - val_loss: 2.5438
Epoch 43/100
85/85 [==============================] - 1s 12ms/step - loss: 3.3254 - val_loss: 2.0694
Epoch 44/100
85/85 [==============================] - 1s 10ms/step - loss: 3.4505 - val_loss: 2.1277
Epoch 45/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4790 - val_loss: 1.9289
Epoch 46/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3112 - val_loss: 1.7008
Epoch 47/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3002 - val_loss: 2.0206
Epoch 48/100
85/85 [==============================] - 1s 10ms/step - loss: 3.3636 - val_loss: 2.5176
Epoch 49/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3763 - val_loss: 2.2845
Epoch 50/100
85/85 [==============================] - 1s 10ms/step - loss: 3.3508 - val_loss: 2.3657
Epoch 51/100
85/85 [==============================] - 1s 14ms/step - loss: 3.3118 - val_loss: 1.9270
Epoch 52/100
85/85 [==============================] - 1s 14ms/step - loss: 3.4400 - val_loss: 2.0921
Epoch 53/100
85/85 [==============================] - 1s 13ms/step - loss: 3.3082 - val_loss: 1.9090
Epoch 54/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2761 - val_loss: 1.9518
Epoch 55/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3200 - val_loss: 2.6154
Epoch 56/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3114 - val_loss: 2.6621
Epoch 57/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3139 - val_loss: 2.2558
Epoch 58/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3307 - val_loss: 1.6483
Epoch 59/100
85/85 [==============================] - 1s 12ms/step - loss: 3.3020 - val_loss: 1.8364
Epoch 60/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1884 - val_loss: 2.1094
Epoch 61/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4052 - val_loss: 2.4968
Epoch 62/100
85/85 [==============================] - 1s 17ms/step - loss: 3.2705 - val_loss: 2.3667
Epoch 63/100
85/85 [==============================] - 1s 14ms/step - loss: 3.1633 - val_loss: 1.8812
Epoch 64/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1679 - val_loss: 2.2619
Epoch 65/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2646 - val_loss: 2.1807
Epoch 66/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1943 - val_loss: 1.8956
Epoch 67/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2872 - val_loss: 1.7815
Epoch 68/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2038 - val_loss: 1.8326
Epoch 69/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2824 - val_loss: 1.7867
Epoch 70/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2236 - val_loss: 1.6547
Epoch 71/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2658 - val_loss: 2.1449
Epoch 72/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2782 - val_loss: 2.0975
Epoch 73/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2478 - val_loss: 2.2757
Epoch 74/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2416 - val_loss: 2.2916
Epoch 75/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2347 - val_loss: 2.0796
Epoch 76/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1576 - val_loss: 2.0963
Epoch 77/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1294 - val_loss: 2.4357
Epoch 78/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1657 - val_loss: 2.6226
Epoch 79/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1464 - val_loss: 2.4189
Epoch 80/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2119 - val_loss: 2.1782
Epoch 81/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2513 - val_loss: 2.5850
Epoch 82/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2056 - val_loss: 1.7091
Epoch 83/100
85/85 [==============================] - 1s 14ms/step - loss: 3.1338 - val_loss: 1.8212
Epoch 84/100
85/85 [==============================] - 1s 15ms/step - loss: 3.1984 - val_loss: 1.8781
Epoch 85/100
85/85 [==============================] - 1s 12ms/step - loss: 3.1545 - val_loss: 2.0418
Epoch 86/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1711 - val_loss: 2.2443
Epoch 87/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1630 - val_loss: 2.1885
Epoch 88/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1326 - val_loss: 2.6047
Epoch 89/100
85/85 [==============================] - 1s 11ms/step - loss: 3.0922 - val_loss: 2.1033
Epoch 90/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1721 - val_loss: 1.8741
Epoch 91/100
85/85 [==============================] - 1s 11ms/step - loss: 3.0409 - val_loss: 1.4296
Epoch 92/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2003 - val_loss: 1.9129
Epoch 93/100
85/85 [==============================] - 1s 12ms/step - loss: 3.1350 - val_loss: 1.5444
Epoch 94/100
85/85 [==============================] - 1s 15ms/step - loss: 3.1073 - val_loss: 2.0192
Epoch 95/100
85/85 [==============================] - 1s 13ms/step - loss: 3.0853 - val_loss: 1.7759
Epoch 96/100
85/85 [==============================] - 1s 11ms/step - loss: 3.0838 - val_loss: 1.9075
Epoch 97/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1072 - val_loss: 1.6052
Epoch 98/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1974 - val_loss: 2.1607
Epoch 99/100
85/85 [==============================] - 1s 10ms/step - loss: 3.0698 - val_loss: 2.3638
Epoch 100/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1350 - val_loss: 2.0014
Epoch 1/100
102/102 [==============================] - 3s 10ms/step - loss: 3.2339
Epoch 2/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1324
Epoch 3/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1350
Epoch 4/100
102/102 [==============================] - 1s 10ms/step - loss: 3.1591
Epoch 5/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0928
Epoch 6/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0864
Epoch 7/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1256
Epoch 8/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1339
Epoch 9/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1692
Epoch 10/100
102/102 [==============================] - 1s 11ms/step - loss: 3.1387
Epoch 11/100
102/102 [==============================] - 1s 12ms/step - loss: 3.0884
Epoch 12/100
102/102 [==============================] - 1s 15ms/step - loss: 3.0873
Epoch 13/100
102/102 [==============================] - 2s 16ms/step - loss: 3.0242
Epoch 14/100
102/102 [==============================] - 1s 13ms/step - loss: 3.0628
Epoch 15/100
102/102 [==============================] - 1s 13ms/step - loss: 3.0870
Epoch 16/100
102/102 [==============================] - 1s 11ms/step - loss: 3.0888
Epoch 17/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0626
Epoch 18/100
102/102 [==============================] - 1s 11ms/step - loss: 3.1335
Epoch 19/100
102/102 [==============================] - 1s 14ms/step - loss: 3.1593
Epoch 20/100
102/102 [==============================] - 2s 18ms/step - loss: 3.0605
Epoch 21/100
102/102 [==============================] - 1s 14ms/step - loss: 3.0381
Epoch 22/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0225
Epoch 23/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0244
Epoch 24/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0537
Epoch 25/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0828
Epoch 26/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0261
Epoch 27/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0043
Epoch 28/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0413
Epoch 29/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0881
Epoch 30/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9915
Epoch 31/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0446
Epoch 32/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9774
Epoch 33/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0876
Epoch 34/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9911
Epoch 35/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9925
Epoch 36/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9801
Epoch 37/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9957
Epoch 38/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9831
Epoch 39/100
102/102 [==============================] - 1s 12ms/step - loss: 2.9472
Epoch 40/100
102/102 [==============================] - 1s 13ms/step - loss: 3.0021
Epoch 41/100
102/102 [==============================] - 1s 11ms/step - loss: 3.0575
Epoch 42/100
102/102 [==============================] - 1s 11ms/step - loss: 3.0051
Epoch 43/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9604
Epoch 44/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0253
Epoch 45/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1109
Epoch 46/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9890
Epoch 47/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0181
Epoch 48/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9452
Epoch 49/100
102/102 [==============================] - 1s 13ms/step - loss: 2.9696
Epoch 50/100
102/102 [==============================] - 1s 13ms/step - loss: 2.9621
Epoch 51/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9468
Epoch 52/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0436
Epoch 53/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0047
Epoch 54/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9342
Epoch 55/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0001
Epoch 56/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9862
Epoch 57/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9889
Epoch 58/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9449
Epoch 59/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9172
Epoch 60/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8701
Epoch 61/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9050
Epoch 62/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9039
Epoch 63/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9217
Epoch 64/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9867
Epoch 65/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9441
Epoch 66/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9076
Epoch 67/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9534
Epoch 68/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9176
Epoch 69/100
102/102 [==============================] - 1s 12ms/step - loss: 2.9052
Epoch 70/100
102/102 [==============================] - 1s 13ms/step - loss: 2.9467
Epoch 71/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9474
Epoch 72/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0187
Epoch 73/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9208
Epoch 74/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9717
Epoch 75/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9329
Epoch 76/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9442
Epoch 77/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9080
Epoch 78/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9387
Epoch 79/100
102/102 [==============================] - 1s 11ms/step - loss: 2.9070
Epoch 80/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9168
Epoch 81/100
102/102 [==============================] - 1s 11ms/step - loss: 2.9478
Epoch 82/100
102/102 [==============================] - 1s 10ms/step - loss: 2.8649
Epoch 83/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8334
Epoch 84/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8383
Epoch 85/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9648
Epoch 86/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8721
Epoch 87/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8458
Epoch 88/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9719
Epoch 89/100
102/102 [==============================] - 1s 12ms/step - loss: 2.8608
Epoch 90/100
102/102 [==============================] - 1s 13ms/step - loss: 2.8715
Epoch 91/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9552
Epoch 92/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8690
Epoch 93/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8911
Epoch 94/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8564
Epoch 95/100
102/102 [==============================] - 1s 11ms/step - loss: 2.8717
Epoch 96/100
102/102 [==============================] - 1s 10ms/step - loss: 2.7675
Epoch 97/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8989
Epoch 98/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8444
Epoch 99/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8390
Epoch 100/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8583
34/34 [==============================] - 0s 3ms/step
Test RMSE: 3.1903854804665612

#### Initial LSTM Models

Code
# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location' (will be used to group)
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)

# 9 month lag
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

def process(df, target_var):
    lag_features = [col for col in df.columns if 'lag' in col or 'rolling' in col]
    df = df[[target_var] + lag_features]
    return df.fillna(0)

def normalize(df, target_var):
    for col in df.columns:
        if col != target_var:
            df[col] = (df[col] - df[col].mean()) / df[col].std()
    return df

# Process and normalize data
df_processed = process(df_encoded, pred_var)
df_normalized = normalize(df_processed, pred_var)

def make_series(data, sequence_length):
    series = []
    # Group by Location to maintain the structure per state
    for location, group in data.groupby(level='Location'):
        group = group.reset_index(level='Location', drop=True)
        for i in range(len(group) - sequence_length):
            subdf = group.iloc[i:i + sequence_length]
            series.append((subdf.index[-1], subdf[pred_var].iloc[-1], subdf.drop(pred_var, axis=1).values))
    return series

# 12 to capture 3 month pattern
sequence_length = 12
series = make_series(df_normalized, sequence_length)

# Split into train and test sets
# 1080 because it represents around 20-30% of df and is a multiple of 12
train = series[:-1080]
test = series[-1080:]

# Keras model 
num_features = df_normalized.shape[1] - 1  # excluding the target variable

inputs = keras.layers.Input(shape=(sequence_length, num_features))
lstm_out = keras.layers.LSTM(32)(inputs)
outputs = keras.layers.Dense(1)(lstm_out)

model = keras.Model(inputs=inputs, outputs=outputs)
model.compile(optimizer=keras.optimizers.Adam(learning_rate=0.01), loss="mae")
model.summary()

# Prepare data for training
x_train = np.array([x[2].reshape(sequence_length, num_features) for x in train])
y_train = np.array([x[1] for x in train])

# Fit the model
history = model.fit(
    x=x_train,
    y=y_train,
    epochs=100,
    batch_size=32,
    shuffle=True
)
Model: "model_12"
_________________________________________________________________
 Layer (type)                Output Shape              Param #   
=================================================================
 input_11 (InputLayer)       [(None, 12, 5)]           0         
                                                                 
 lstm_984 (LSTM)             (None, 32)                4864      
                                                                 
 dense_497 (Dense)           (None, 1)                 33        
                                                                 
=================================================================
Total params: 4,897
Trainable params: 4,897
Non-trainable params: 0
_________________________________________________________________
Epoch 1/100
2023-11-26 23:46:40.047073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:46:40.047631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:46:40.048099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:46:40.132240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:46:40.132682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:46:40.133059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:46:40.281080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:46:40.281707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:46:40.282133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 1s 2ms/step - loss: 25.5301
Epoch 2/100
102/102 [==============================] - 0s 1ms/step - loss: 7.6057
Epoch 3/100
102/102 [==============================] - 0s 1ms/step - loss: 7.2921
Epoch 4/100
102/102 [==============================] - 0s 1ms/step - loss: 7.2557
Epoch 5/100
102/102 [==============================] - 0s 1ms/step - loss: 7.0128
Epoch 6/100
102/102 [==============================] - 0s 1ms/step - loss: 6.9401
Epoch 7/100
102/102 [==============================] - 0s 1ms/step - loss: 6.9169
Epoch 8/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8922
Epoch 9/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8773
Epoch 10/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8709
Epoch 11/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8876
Epoch 12/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8294
Epoch 13/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8227
Epoch 14/100
102/102 [==============================] - 0s 2ms/step - loss: 6.8443
Epoch 15/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8317
Epoch 16/100
102/102 [==============================] - 0s 1ms/step - loss: 6.7958
Epoch 17/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8077
Epoch 18/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8401
Epoch 19/100
102/102 [==============================] - 0s 1ms/step - loss: 6.8841
Epoch 20/100
102/102 [==============================] - 0s 2ms/step - loss: 6.9812
Epoch 21/100
102/102 [==============================] - 0s 2ms/step - loss: 6.6304
Epoch 22/100
102/102 [==============================] - 0s 1ms/step - loss: 6.6350
Epoch 23/100
102/102 [==============================] - 0s 1ms/step - loss: 6.3084
Epoch 24/100
102/102 [==============================] - 0s 1ms/step - loss: 6.0620
Epoch 25/100
102/102 [==============================] - 0s 1ms/step - loss: 5.8040
Epoch 26/100
102/102 [==============================] - 0s 1ms/step - loss: 5.6068
Epoch 27/100
102/102 [==============================] - 0s 1ms/step - loss: 5.4474
Epoch 28/100
102/102 [==============================] - 0s 2ms/step - loss: 5.3225
Epoch 29/100
102/102 [==============================] - 0s 1ms/step - loss: 5.3470
Epoch 30/100
102/102 [==============================] - 0s 1ms/step - loss: 5.0074
Epoch 31/100
102/102 [==============================] - 0s 1ms/step - loss: 4.9351
Epoch 32/100
102/102 [==============================] - 0s 1ms/step - loss: 4.7602
Epoch 33/100
102/102 [==============================] - 0s 1ms/step - loss: 4.6285
Epoch 34/100
102/102 [==============================] - 0s 1ms/step - loss: 4.4675
Epoch 35/100
102/102 [==============================] - 0s 1ms/step - loss: 4.4010
Epoch 36/100
102/102 [==============================] - 0s 1ms/step - loss: 4.2835
Epoch 37/100
102/102 [==============================] - 0s 1ms/step - loss: 4.4040
Epoch 38/100
102/102 [==============================] - 0s 1ms/step - loss: 4.4473
Epoch 39/100
102/102 [==============================] - 0s 1ms/step - loss: 4.0977
Epoch 40/100
102/102 [==============================] - 0s 1ms/step - loss: 3.8145
Epoch 41/100
102/102 [==============================] - 0s 1ms/step - loss: 3.7378
Epoch 42/100
102/102 [==============================] - 0s 1ms/step - loss: 3.5672
Epoch 43/100
102/102 [==============================] - 0s 1ms/step - loss: 3.4578
Epoch 44/100
102/102 [==============================] - 0s 1ms/step - loss: 3.2798
Epoch 45/100
102/102 [==============================] - 0s 1ms/step - loss: 3.3827
Epoch 46/100
102/102 [==============================] - 0s 1ms/step - loss: 3.1745
Epoch 47/100
102/102 [==============================] - 0s 1ms/step - loss: 3.0505
Epoch 48/100
102/102 [==============================] - 0s 1ms/step - loss: 3.0097
Epoch 49/100
102/102 [==============================] - 0s 1ms/step - loss: 2.8990
Epoch 50/100
102/102 [==============================] - 0s 2ms/step - loss: 2.8465
Epoch 51/100
102/102 [==============================] - 0s 1ms/step - loss: 3.0025
Epoch 52/100
102/102 [==============================] - 0s 1ms/step - loss: 2.7990
Epoch 53/100
102/102 [==============================] - 0s 1ms/step - loss: 2.6909
Epoch 54/100
102/102 [==============================] - 0s 1ms/step - loss: 2.5386
Epoch 55/100
102/102 [==============================] - 0s 1ms/step - loss: 2.6628
Epoch 56/100
102/102 [==============================] - 0s 1ms/step - loss: 2.4346
Epoch 57/100
102/102 [==============================] - 0s 1ms/step - loss: 2.3166
Epoch 58/100
102/102 [==============================] - 0s 2ms/step - loss: 2.3529
Epoch 59/100
102/102 [==============================] - 0s 1ms/step - loss: 2.3005
Epoch 60/100
102/102 [==============================] - 0s 1ms/step - loss: 2.2598
Epoch 61/100
102/102 [==============================] - 0s 1ms/step - loss: 2.0282
Epoch 62/100
102/102 [==============================] - 0s 1ms/step - loss: 2.2789
Epoch 63/100
102/102 [==============================] - 0s 1ms/step - loss: 2.2757
Epoch 64/100
102/102 [==============================] - 0s 1ms/step - loss: 2.1358
Epoch 65/100
102/102 [==============================] - 0s 1ms/step - loss: 1.8905
Epoch 66/100
102/102 [==============================] - 0s 1ms/step - loss: 1.9583
Epoch 67/100
102/102 [==============================] - 0s 1ms/step - loss: 1.8738
Epoch 68/100
102/102 [==============================] - 0s 1ms/step - loss: 2.8627
Epoch 69/100
102/102 [==============================] - 0s 1ms/step - loss: 3.4515
Epoch 70/100
102/102 [==============================] - 0s 1ms/step - loss: 2.7054
Epoch 71/100
102/102 [==============================] - 0s 1ms/step - loss: 2.2230
Epoch 72/100
102/102 [==============================] - 0s 1ms/step - loss: 1.9557
Epoch 73/100
102/102 [==============================] - 0s 2ms/step - loss: 1.8098
Epoch 74/100
102/102 [==============================] - 0s 1ms/step - loss: 1.7715
Epoch 75/100
102/102 [==============================] - 0s 1ms/step - loss: 1.9294
Epoch 76/100
102/102 [==============================] - 0s 1ms/step - loss: 2.3910
Epoch 77/100
102/102 [==============================] - 0s 1ms/step - loss: 1.9550
Epoch 78/100
102/102 [==============================] - 0s 1ms/step - loss: 1.7997
Epoch 79/100
102/102 [==============================] - 0s 1ms/step - loss: 1.5400
Epoch 80/100
102/102 [==============================] - 0s 1ms/step - loss: 1.5489
Epoch 81/100
102/102 [==============================] - 0s 1ms/step - loss: 1.6310
Epoch 82/100
102/102 [==============================] - 0s 1ms/step - loss: 1.4984
Epoch 83/100
102/102 [==============================] - 0s 1ms/step - loss: 1.4072
Epoch 84/100
102/102 [==============================] - 0s 1ms/step - loss: 1.2964
Epoch 85/100
102/102 [==============================] - 0s 1ms/step - loss: 1.2726
Epoch 86/100
102/102 [==============================] - 0s 1ms/step - loss: 1.3035
Epoch 87/100
102/102 [==============================] - 0s 1ms/step - loss: 1.3707
Epoch 88/100
102/102 [==============================] - 0s 2ms/step - loss: 1.3539
Epoch 89/100
102/102 [==============================] - 0s 1ms/step - loss: 1.2437
Epoch 90/100
102/102 [==============================] - 0s 1ms/step - loss: 1.3406
Epoch 91/100
102/102 [==============================] - 0s 1ms/step - loss: 1.2859
Epoch 92/100
102/102 [==============================] - 0s 1ms/step - loss: 1.2139
Epoch 93/100
102/102 [==============================] - 0s 1ms/step - loss: 1.1302
Epoch 94/100
102/102 [==============================] - 0s 1ms/step - loss: 1.1005
Epoch 95/100
102/102 [==============================] - 0s 1ms/step - loss: 1.1369
Epoch 96/100
102/102 [==============================] - 0s 1ms/step - loss: 1.1432
Epoch 97/100
102/102 [==============================] - 0s 1ms/step - loss: 1.2833
Epoch 98/100
102/102 [==============================] - 0s 1ms/step - loss: 1.1569
Epoch 99/100
102/102 [==============================] - 0s 1ms/step - loss: 1.1601
Epoch 100/100
102/102 [==============================] - 0s 1ms/step - loss: 1.1557
Code
# Reshape the input data for the model
x_test = np.array([x[2].reshape(sequence_length, num_features) for x in test])

# Generate predictions for training data
train_pred = model.predict(np.array([x[2] for x in train]))
train_pred = pd.DataFrame(train_pred, columns=['yhat'], index=[x[0] for x in train])

# Actual values for training data
train_gt = pd.DataFrame([x[1] for x in train], columns=['y'], index=[x[0] for x in train])

# Plot training predictions and actual values
pd.concat([train_gt, train_pred], axis=1).plot(figsize=(20,10))
plt.legend(['train_gt', 'train_pred'])
plt.title('Training Data: Actual vs Predicted')
plt.show()

# Generate predictions for test data
test_pred = model.predict(x_test)
test_pred = pd.DataFrame(test_pred, columns=['yhat'], index=[x[0] for x in test])

# Actual values for test data
test_gt = pd.DataFrame([x[1] for x in test], columns=['y'], index=[x[0] for x in test])

# Plot test predictions and actual values
pd.concat([test_gt, test_pred], axis=1).plot(figsize=(20,10))
plt.legend(['test_gt', 'test_pred'])
plt.title('Test Data: Actual vs Predicted')
plt.show()
102/102 [==============================] - 0s 482us/step
2023-11-26 23:47:07.636633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:47:07.637390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:47:07.637763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 536us/step

Code
def mean_absolute_percentage_error(y_true, y_pred): 
    return np.mean(np.abs((y_true - y_pred) / y_true)) * 100
y_test = np.array([x[1] for x in test])
# Assuming y_train and y_test are your actual values and train_pred, test_pred are your model's predictions
y_train_pred = model.predict(x_train).flatten()
y_test_pred = model.predict(x_test).flatten()

# Training Metrics
train_mae = mean_absolute_error(y_train, y_train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, y_train_pred))
train_mape = mean_absolute_percentage_error(y_train, y_train_pred)
train_r2 = r2_score(y_train, y_train_pred)

# Test Metrics
test_mae = mean_absolute_error(y_test, y_test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, y_test_pred))
test_mape = mean_absolute_percentage_error(y_test, y_test_pred)
test_r2 = r2_score(y_test, y_test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}, RMSE: {train_rmse}, MAPE: {train_mape}, R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}, RMSE: {test_rmse}, MAPE: {test_mape}, R2: {test_r2}")
102/102 [==============================] - 0s 512us/step
34/34 [==============================] - 0s 486us/step
Training Metrics:
MAE: 1.0027659092870955, RMSE: 1.8308575806559573, MAPE: inf, R2: 0.9642332274409814

Test Metrics:
MAE: 9.523935102136047, RMSE: 12.481477177871838, MAPE: 20.580936793979898, R2: -0.8551982553937632
Code
# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location' (will be used to group)
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)

# 9 month lag
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

def process(df, target_var):
    lag_features = [col for col in df.columns if 'lag' in col or 'rolling' in col]
    df = df[[target_var] + lag_features]
    return df.fillna(0)

# Normalize features based on training data
def normalize(train, test):
    mean = train.mean()
    std = train.std()
    
    train_normalized = (train - mean) / std
    test_normalized = (test - mean) / std
    
    return train_normalized, test_normalized

# Split into train and test sets (before normalization to prevent leakage)
# 1080 because it represents around 20-30% of df and is a multiple of 12
test_size = 1080 
train_df = df_encoded.iloc[:-test_size]
test_df = df_encoded.iloc[-test_size:]

# Process train and test sets separately
train_processed = process(train_df, pred_var)
test_processed = process(test_df, pred_var)

# Normalize the processed data
train_normalized, test_normalized = normalize(train_processed, test_processed)

# Create sequences for LSTM
def make_series(data, sequence_length):
    series = []
    for location, group in data.groupby(level='Location'):
        group = group.reset_index(level='Location', drop=True)
        for i in range(sequence_length, len(group)):
            sequence = group[i-sequence_length:i]
            target = group.iloc[i][pred_var]
            series.append((sequence.index[0], target, sequence.drop(pred_var, axis=1).values))
    return series

# 12 to capture 3 month pattern
sequence_length = 12
# Create sequences for LSTM from the normalized data
train_series = make_series(train_normalized, sequence_length)
test_series = make_series(test_normalized, sequence_length)

# Prepare data for LSTM
x_train = np.array([x[2] for x in train_series])
y_train = np.array([x[1] for x in train_series])

x_test = np.array([x[2] for x in test_series])
y_test = np.array([x[1] for x in test_series])

# LSTM model with Dropout
inputs = Input(shape=(sequence_length, x_train.shape[2]))
lstm_out = LSTM(32, return_sequences=False)(inputs)
lstm_out = Dropout(0.2)(lstm_out)  # Add dropout
outputs = Dense(1)(lstm_out)

model = Model(inputs=inputs, outputs=outputs)
model.compile(optimizer='adam', loss='mae')

# Fit the model
history = model.fit(
    x_train, y_train,
    epochs=100,
    batch_size=32,
    validation_data=(x_test, y_test),  # Add validation data
    shuffle=False  # Do not shuffle time series data
)
Epoch 1/100
2023-11-26 23:48:22.664283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:48:22.664694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:48:22.665273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:48:22.740755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:48:22.741262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:48:22.741684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:48:22.906973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:48:22.907491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:48:22.908028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 1s 3ms/step - loss: 0.5847 - val_loss: 0.5576
Epoch 2/100
 68/102 [===================>..........] - ETA: 0s - loss: 0.5482
2023-11-26 23:48:23.393231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:48:23.393915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:48:23.394392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 0s 2ms/step - loss: 0.5533 - val_loss: 0.5289
Epoch 3/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5396 - val_loss: 0.5258
Epoch 4/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5311 - val_loss: 0.5234
Epoch 5/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5263 - val_loss: 0.5239
Epoch 6/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5170 - val_loss: 0.5118
Epoch 7/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5127 - val_loss: 0.5114
Epoch 8/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5098 - val_loss: 0.5124
Epoch 9/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5022 - val_loss: 0.5087
Epoch 10/100
102/102 [==============================] - 0s 2ms/step - loss: 0.5018 - val_loss: 0.5040
Epoch 11/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4974 - val_loss: 0.5132
Epoch 12/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4968 - val_loss: 0.4968
Epoch 13/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4942 - val_loss: 0.4994
Epoch 14/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4918 - val_loss: 0.5018
Epoch 15/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4891 - val_loss: 0.5001
Epoch 16/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4862 - val_loss: 0.4978
Epoch 17/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4823 - val_loss: 0.4920
Epoch 18/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4817 - val_loss: 0.4905
Epoch 19/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4810 - val_loss: 0.4950
Epoch 20/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4783 - val_loss: 0.5028
Epoch 21/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4770 - val_loss: 0.4918
Epoch 22/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4740 - val_loss: 0.4967
Epoch 23/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4705 - val_loss: 0.4899
Epoch 24/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4704 - val_loss: 0.4944
Epoch 25/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4659 - val_loss: 0.4918
Epoch 26/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4666 - val_loss: 0.5001
Epoch 27/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4657 - val_loss: 0.4976
Epoch 28/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4605 - val_loss: 0.5038
Epoch 29/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4630 - val_loss: 0.4931
Epoch 30/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4595 - val_loss: 0.4983
Epoch 31/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4608 - val_loss: 0.4945
Epoch 32/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4565 - val_loss: 0.4946
Epoch 33/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4585 - val_loss: 0.5031
Epoch 34/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4554 - val_loss: 0.4966
Epoch 35/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4564 - val_loss: 0.4965
Epoch 36/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4536 - val_loss: 0.5018
Epoch 37/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4527 - val_loss: 0.5004
Epoch 38/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4525 - val_loss: 0.5006
Epoch 39/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4499 - val_loss: 0.5029
Epoch 40/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4479 - val_loss: 0.4987
Epoch 41/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4485 - val_loss: 0.5002
Epoch 42/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4500 - val_loss: 0.4946
Epoch 43/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4449 - val_loss: 0.5009
Epoch 44/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4447 - val_loss: 0.4986
Epoch 45/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4434 - val_loss: 0.4947
Epoch 46/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4396 - val_loss: 0.5005
Epoch 47/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4398 - val_loss: 0.4955
Epoch 48/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4428 - val_loss: 0.5040
Epoch 49/100
102/102 [==============================] - 0s 1ms/step - loss: 0.4409 - val_loss: 0.4905
Epoch 50/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4376 - val_loss: 0.5035
Epoch 51/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4342 - val_loss: 0.5113
Epoch 52/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4325 - val_loss: 0.5088
Epoch 53/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4321 - val_loss: 0.5080
Epoch 54/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4320 - val_loss: 0.5105
Epoch 55/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4303 - val_loss: 0.5177
Epoch 56/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4296 - val_loss: 0.5226
Epoch 57/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4288 - val_loss: 0.5084
Epoch 58/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4278 - val_loss: 0.5197
Epoch 59/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4215 - val_loss: 0.5134
Epoch 60/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4247 - val_loss: 0.5239
Epoch 61/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4213 - val_loss: 0.5403
Epoch 62/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4200 - val_loss: 0.5401
Epoch 63/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4180 - val_loss: 0.5349
Epoch 64/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4163 - val_loss: 0.5338
Epoch 65/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4186 - val_loss: 0.5392
Epoch 66/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4152 - val_loss: 0.5480
Epoch 67/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4119 - val_loss: 0.5320
Epoch 68/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4169 - val_loss: 0.5334
Epoch 69/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4161 - val_loss: 0.5107
Epoch 70/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4086 - val_loss: 0.5409
Epoch 71/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4063 - val_loss: 0.5366
Epoch 72/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4042 - val_loss: 0.5112
Epoch 73/100
102/102 [==============================] - 0s 2ms/step - loss: 0.4001 - val_loss: 0.5205
Epoch 74/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3983 - val_loss: 0.5127
Epoch 75/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3987 - val_loss: 0.5097
Epoch 76/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3992 - val_loss: 0.5220
Epoch 77/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3941 - val_loss: 0.5222
Epoch 78/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3950 - val_loss: 0.5146
Epoch 79/100
102/102 [==============================] - 0s 1ms/step - loss: 0.3868 - val_loss: 0.5102
Epoch 80/100
102/102 [==============================] - 0s 1ms/step - loss: 0.3875 - val_loss: 0.4944
Epoch 81/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3874 - val_loss: 0.4937
Epoch 82/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3870 - val_loss: 0.5022
Epoch 83/100
102/102 [==============================] - 0s 1ms/step - loss: 0.3849 - val_loss: 0.4902
Epoch 84/100
102/102 [==============================] - 0s 1ms/step - loss: 0.3807 - val_loss: 0.4960
Epoch 85/100
102/102 [==============================] - 0s 1ms/step - loss: 0.3798 - val_loss: 0.4768
Epoch 86/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3752 - val_loss: 0.4835
Epoch 87/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3728 - val_loss: 0.4944
Epoch 88/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3734 - val_loss: 0.4770
Epoch 89/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3751 - val_loss: 0.4620
Epoch 90/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3683 - val_loss: 0.4662
Epoch 91/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3674 - val_loss: 0.4609
Epoch 92/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3680 - val_loss: 0.4597
Epoch 93/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3647 - val_loss: 0.4622
Epoch 94/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3643 - val_loss: 0.4652
Epoch 95/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3592 - val_loss: 0.4640
Epoch 96/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3594 - val_loss: 0.4572
Epoch 97/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3577 - val_loss: 0.4539
Epoch 98/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3586 - val_loss: 0.4568
Epoch 99/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3546 - val_loss: 0.4496
Epoch 100/100
102/102 [==============================] - 0s 2ms/step - loss: 0.3532 - val_loss: 0.4403
Code
# Predictions
train_pred = model.predict(x_train).flatten()  # Flatten to ensure it's a 1D array
test_pred = model.predict(x_test).flatten()

# Create DataFrames for the actual and predicted values with proper indexing
# Ensure the index is constructed correctly for the training ground truth
train_indices = [x[0] for x in train_series]
train_gt = pd.DataFrame(y_train, columns=['y'], index=train_indices)
train_pred_df = pd.DataFrame(train_pred, columns=['yhat'], index=train_indices)

# Plot training predictions and actual values
pd.concat([train_gt, train_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Training Data: Actual vs Predicted')
# Ensure the index is constructed correctly for the test ground truth
test_indices = [x[0] for x in test_series]
test_gt = pd.DataFrame(y_test, columns=['y'], index=test_indices)
test_pred_df = pd.DataFrame(test_pred, columns=['yhat'], index=test_indices)

# Plot test predictions and actual values
pd.concat([test_gt, test_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Test Data: Actual vs Predicted')
plt.show()
102/102 [==============================] - 0s 527us/step
10/10 [==============================] - 0s 561us/step
2023-11-26 23:48:43.992624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:48:43.993241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:48:43.993632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

Code
# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}")
print(f"RMSE: {train_rmse}")
print(f"R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}")
print(f"RMSE: {test_rmse}")
print(f"R2: {test_r2}")
Training Metrics:
MAE: 0.32132062828470276
RMSE: 0.5087964874903663
R2: 0.5104386525815892

Test Metrics:
MAE: 0.4402810355811421
RMSE: 0.6017327587533764
R2: 0.07906001131408491
Code
def build_model(sequence_length, num_features):
    inputs = Input(shape=(sequence_length, num_features))
    lstm_out = Bidirectional(LSTM(16, return_sequences=True, 
                                  kernel_regularizer=l1_l2(l1=0.01, l2=0.01)))(inputs)
    lstm_out = BatchNormalization()(lstm_out)
    lstm_out = Dropout(0.5)(lstm_out)
    lstm_out = LSTM(8, return_sequences=False,
                    kernel_regularizer=l1_l2(l1=0.01, l2=0.01))(lstm_out)
    lstm_out = BatchNormalization()(lstm_out)
    lstm_out = Dropout(0.5)(lstm_out)
    outputs = Dense(1)(lstm_out)
    
    model = Model(inputs=inputs, outputs=outputs)
    model.compile(optimizer='adam', loss='mae')
    return model

# Create the model
model = build_model(sequence_length, num_features)

# Early stopping to prevent overfitting
early_stopping = EarlyStopping(monitor='val_loss', patience=10, restore_best_weights=True)

# Fit the model with early stopping
history = model.fit(
    x_train, y_train,
    epochs=100,
    batch_size=64,
    validation_data=(x_test, y_test),
    shuffle=False,
    callbacks=[early_stopping]
)

# Predictions
train_pred = model.predict(x_train).flatten()
test_pred = model.predict(x_test).flatten()

# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}, RMSE: {train_rmse}, R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}, RMSE: {test_rmse}, R2: {test_r2}")
Epoch 1/100
2023-11-26 23:49:59.433416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:49:59.434069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:49:59.434567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:49:59.471205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis' with dtype int32 and shape [1]
     [[{{node gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis}}]]
2023-11-26 23:49:59.482345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:49:59.482692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:49:59.482997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:49:59.537395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:49:59.537772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:49:59.538092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:49:59.626000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:49:59.626648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:49:59.627220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:49:59.678493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis' with dtype int32 and shape [1]
     [[{{node gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis}}]]
2023-11-26 23:49:59.695182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:49:59.695747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:49:59.696220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:49:59.759907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:49:59.760366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:49:59.761263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:00.029102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis' with dtype int32 and shape [1]
     [[{{node gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis}}]]
2023-11-26 23:50:00.127870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:00.128456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:00.128946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:00.176936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis' with dtype int32 and shape [1]
     [[{{node gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis}}]]
2023-11-26 23:50:00.194138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:00.194676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:00.195145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:00.260855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:00.261400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:00.261768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:00.515802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis' with dtype int32 and shape [1]
     [[{{node gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis}}]]
38/51 [=====================>........] - ETA: 0s - loss: 4.1580
2023-11-26 23:50:01.211184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:01.212059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:01.212610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:01.259122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis' with dtype int32 and shape [1]
     [[{{node gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis}}]]
2023-11-26 23:50:01.277043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:01.277582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:01.278068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:01.338914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:01.339421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:01.339930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 2s 10ms/step - loss: 4.0454 - val_loss: 3.2118
Epoch 2/100
51/51 [==============================] - 0s 3ms/step - loss: 3.2748 - val_loss: 2.6666
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 2.7065 - val_loss: 2.1819
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 2.2269 - val_loss: 1.8053
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 1.8245 - val_loss: 1.4718
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 1.5375 - val_loss: 1.2492
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 1.2946 - val_loss: 1.0817
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 1.1391 - val_loss: 0.9650
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 1.0215 - val_loss: 0.8928
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.9248 - val_loss: 0.8378
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.8636 - val_loss: 0.7895
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.8068 - val_loss: 0.7462
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.7677 - val_loss: 0.7143
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.7302 - val_loss: 0.6845
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.6950 - val_loss: 0.6628
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.6683 - val_loss: 0.6417
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.6447 - val_loss: 0.6322
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.6269 - val_loss: 0.6368
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.6137 - val_loss: 0.6106
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5953 - val_loss: 0.6046
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5839 - val_loss: 0.5851
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5802 - val_loss: 0.5769
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5737 - val_loss: 0.5727
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5632 - val_loss: 0.5756
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5607 - val_loss: 0.5764
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5542 - val_loss: 0.5683
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5520 - val_loss: 0.5623
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5477 - val_loss: 0.5575
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5432 - val_loss: 0.5628
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5434 - val_loss: 0.5498
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5426 - val_loss: 0.5444
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5394 - val_loss: 0.5500
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5378 - val_loss: 0.5451
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5369 - val_loss: 0.5422
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5358 - val_loss: 0.5464
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5357 - val_loss: 0.5445
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5325 - val_loss: 0.5474
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5331 - val_loss: 0.5472
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5361 - val_loss: 0.5450
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5368 - val_loss: 0.5374
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5364 - val_loss: 0.5400
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5353 - val_loss: 0.5428
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5331 - val_loss: 0.5384
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5331 - val_loss: 0.5376
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5342 - val_loss: 0.5448
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5309 - val_loss: 0.5341
Epoch 47/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5314 - val_loss: 0.5364
Epoch 48/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5309 - val_loss: 0.5283
Epoch 49/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5306 - val_loss: 0.5352
Epoch 50/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5275 - val_loss: 0.5274
Epoch 51/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5296 - val_loss: 0.5327
Epoch 52/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5299 - val_loss: 0.5298
Epoch 53/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5310 - val_loss: 0.5336
Epoch 54/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5315 - val_loss: 0.5360
Epoch 55/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5278 - val_loss: 0.5349
Epoch 56/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5292 - val_loss: 0.5311
Epoch 57/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5281 - val_loss: 0.5345
Epoch 58/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5296 - val_loss: 0.5266
Epoch 59/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5296 - val_loss: 0.5341
Epoch 60/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5280 - val_loss: 0.5269
Epoch 61/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5280 - val_loss: 0.5408
Epoch 62/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5279 - val_loss: 0.5337
Epoch 63/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5294 - val_loss: 0.5315
Epoch 64/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5289 - val_loss: 0.5272
Epoch 65/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5278 - val_loss: 0.5337
Epoch 66/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5281 - val_loss: 0.5284
Epoch 67/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5283 - val_loss: 0.5340
Epoch 68/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5270 - val_loss: 0.5250
Epoch 69/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5283 - val_loss: 0.5231
Epoch 70/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5269 - val_loss: 0.5354
Epoch 71/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5275 - val_loss: 0.5299
Epoch 72/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5259 - val_loss: 0.5223
Epoch 73/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5251 - val_loss: 0.5257
Epoch 74/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5267 - val_loss: 0.5335
Epoch 75/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5253 - val_loss: 0.5300
Epoch 76/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5279 - val_loss: 0.5277
Epoch 77/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5265 - val_loss: 0.5252
Epoch 78/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5273 - val_loss: 0.5286
Epoch 79/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5252 - val_loss: 0.5372
Epoch 80/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5262 - val_loss: 0.5247
Epoch 81/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5261 - val_loss: 0.5203
Epoch 82/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5257 - val_loss: 0.5260
Epoch 83/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5279 - val_loss: 0.5278
Epoch 84/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5260 - val_loss: 0.5248
Epoch 85/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5254 - val_loss: 0.5358
Epoch 86/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5254 - val_loss: 0.5375
Epoch 87/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5285 - val_loss: 0.5246
Epoch 88/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5259 - val_loss: 0.5165
Epoch 89/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5252 - val_loss: 0.5161
Epoch 90/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5277 - val_loss: 0.5308
Epoch 91/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5267 - val_loss: 0.5243
Epoch 92/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5274 - val_loss: 0.5258
Epoch 93/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5274 - val_loss: 0.5309
Epoch 94/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5272 - val_loss: 0.5402
Epoch 95/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5278 - val_loss: 0.5276
Epoch 96/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5258 - val_loss: 0.5239
Epoch 97/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5288 - val_loss: 0.5324
Epoch 98/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5264 - val_loss: 0.5269
Epoch 99/100
51/51 [==============================] - 0s 4ms/step - loss: 0.5259 - val_loss: 0.5262
2023-11-26 23:50:18.245453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:18.246018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:18.246805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:18.296902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis' with dtype int32 and shape [1]
     [[{{node gradients/ReverseV2_grad/ReverseV2/ReverseV2/axis}}]]
2023-11-26 23:50:18.313420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:18.313923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:18.314416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:18.374907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:18.375371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:18.375768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 0s 733us/step
10/10 [==============================] - 0s 644us/step
Training Metrics:
MAE: 0.5280873855808057, RMSE: 0.6979632663740379, R2: 0.07873611743656428

Test Metrics:
MAE: 0.5096343912046123, RMSE: 0.6432547256348792, R2: -0.05242217698384932
Code
# Define a Learning Rate Scheduler
def scheduler(epoch, lr):
    if epoch < 10:
        return lr
    else:
        return lr * np.exp(-0.1)

# Build the LSTM model with added complexity and regularization
def build_model(input_shape, output_units=1, neurons=64, dropout=0.3, regularization=(0.01, 0.01)):
    model = Sequential()
    model.add(LSTM(neurons, return_sequences=True, input_shape=input_shape,
                   kernel_regularizer=l1_l2(*regularization)))
    model.add(Dropout(dropout))
    model.add(LSTM(neurons, return_sequences=False, 
                   kernel_regularizer=l1_l2(*regularization)))
    model.add(Dropout(dropout))
    model.add(Dense(output_units))
    
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')
    return model

# Callbacks
lr_schedule = LearningRateScheduler(scheduler)
early_stopping = EarlyStopping(monitor='val_loss', patience=10)

# Model training
model = build_model(input_shape=(sequence_length, x_train.shape[2]))
history = model.fit(
    x_train, y_train,
    epochs=100,
    batch_size=64,
    validation_data=(x_test, y_test),
    shuffle=False,
    callbacks=[lr_schedule, early_stopping]
)

# Plot the training and validation loss
plt.plot(history.history['loss'], label='train')
plt.plot(history.history['val_loss'], label='test')
plt.legend()
plt.show()

# Generate predictions
train_pred = model.predict(x_train)
test_pred = model.predict(x_test)

# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}, RMSE: {train_rmse}, R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}, RMSE: {test_rmse}, R2: {test_r2}")
Epoch 1/100
2023-11-26 23:50:23.894877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:23.895289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:23.895896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:23.951223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:23.951658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:23.952035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:24.032931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:24.033440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:24.033874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:24.094017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:24.094511: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:24.094937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:24.358790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:24.359376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:24.359916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:50:24.423999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:24.424543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:24.425015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
50/51 [============================>.] - ETA: 0s - loss: 9.8146 
2023-11-26 23:50:25.363693: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:25.364158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:25.364868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 2s 19ms/step - loss: 9.7413 - val_loss: 6.1680 - lr: 0.0010
Epoch 2/100
 5/51 [=>............................] - ETA: 0s - loss: 5.8651
2023-11-26 23:50:25.762808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:50:25.763323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:50:25.763731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 8ms/step - loss: 3.8735 - val_loss: 2.0472 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 8ms/step - loss: 1.2298 - val_loss: 0.8082 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 9ms/step - loss: 0.7089 - val_loss: 0.6594 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 8ms/step - loss: 0.6311 - val_loss: 0.6214 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 8ms/step - loss: 0.6068 - val_loss: 0.6075 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5970 - val_loss: 0.6020 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5902 - val_loss: 0.5936 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5850 - val_loss: 0.5960 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5822 - val_loss: 0.5870 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5771 - val_loss: 0.5826 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5727 - val_loss: 0.5745 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5693 - val_loss: 0.5691 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5661 - val_loss: 0.5638 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5619 - val_loss: 0.5618 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5589 - val_loss: 0.5565 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5564 - val_loss: 0.5542 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5552 - val_loss: 0.5523 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5519 - val_loss: 0.5499 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5507 - val_loss: 0.5492 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5485 - val_loss: 0.5458 - lr: 3.3287e-04
Epoch 22/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5497 - val_loss: 0.5477 - lr: 3.0119e-04
Epoch 23/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5469 - val_loss: 0.5453 - lr: 2.7253e-04
Epoch 24/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5451 - val_loss: 0.5430 - lr: 2.4660e-04
Epoch 25/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5431 - val_loss: 0.5429 - lr: 2.2313e-04
Epoch 26/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5437 - val_loss: 0.5421 - lr: 2.0190e-04
Epoch 27/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5417 - val_loss: 0.5422 - lr: 1.8268e-04
Epoch 28/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5412 - val_loss: 0.5413 - lr: 1.6530e-04
Epoch 29/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5400 - val_loss: 0.5397 - lr: 1.4957e-04
Epoch 30/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5400 - val_loss: 0.5395 - lr: 1.3534e-04
Epoch 31/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5392 - val_loss: 0.5393 - lr: 1.2246e-04
Epoch 32/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5393 - val_loss: 0.5393 - lr: 1.1080e-04
Epoch 33/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5390 - val_loss: 0.5391 - lr: 1.0026e-04
Epoch 34/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5377 - val_loss: 0.5386 - lr: 9.0718e-05
Epoch 35/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5372 - val_loss: 0.5379 - lr: 8.2085e-05
Epoch 36/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5366 - val_loss: 0.5369 - lr: 7.4274e-05
Epoch 37/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5376 - val_loss: 0.5371 - lr: 6.7206e-05
Epoch 38/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5360 - val_loss: 0.5368 - lr: 6.0810e-05
Epoch 39/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5366 - val_loss: 0.5365 - lr: 5.5023e-05
Epoch 40/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5365 - val_loss: 0.5357 - lr: 4.9787e-05
Epoch 41/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5361 - val_loss: 0.5358 - lr: 4.5049e-05
Epoch 42/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5347 - val_loss: 0.5353 - lr: 4.0762e-05
Epoch 43/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5358 - val_loss: 0.5354 - lr: 3.6883e-05
Epoch 44/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5347 - val_loss: 0.5350 - lr: 3.3373e-05
Epoch 45/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5346 - val_loss: 0.5349 - lr: 3.0197e-05
Epoch 46/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5350 - val_loss: 0.5349 - lr: 2.7324e-05
Epoch 47/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5354 - val_loss: 0.5347 - lr: 2.4724e-05
Epoch 48/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5343 - val_loss: 0.5347 - lr: 2.2371e-05
Epoch 49/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5349 - val_loss: 0.5347 - lr: 2.0242e-05
Epoch 50/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5345 - val_loss: 0.5346 - lr: 1.8316e-05
Epoch 51/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5340 - val_loss: 0.5346 - lr: 1.6573e-05
Epoch 52/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5345 - val_loss: 0.5345 - lr: 1.4996e-05
Epoch 53/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5327 - val_loss: 0.5344 - lr: 1.3569e-05
Epoch 54/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5349 - val_loss: 0.5344 - lr: 1.2277e-05
Epoch 55/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5344 - val_loss: 0.5345 - lr: 1.1109e-05
Epoch 56/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5335 - val_loss: 0.5345 - lr: 1.0052e-05
Epoch 57/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5358 - val_loss: 0.5344 - lr: 9.0953e-06
Epoch 58/100
51/51 [==============================] - 0s 9ms/step - loss: 0.5343 - val_loss: 0.5344 - lr: 8.2297e-06
Epoch 59/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5328 - val_loss: 0.5342 - lr: 7.4466e-06
Epoch 60/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5338 - val_loss: 0.5342 - lr: 6.7379e-06
Epoch 61/100
51/51 [==============================] - 0s 9ms/step - loss: 0.5331 - val_loss: 0.5341 - lr: 6.0967e-06
Epoch 62/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5342 - val_loss: 0.5341 - lr: 5.5166e-06
Epoch 63/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5344 - val_loss: 0.5340 - lr: 4.9916e-06
Epoch 64/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5340 - val_loss: 0.5340 - lr: 4.5166e-06
Epoch 65/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5350 - val_loss: 0.5340 - lr: 4.0868e-06
Epoch 66/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5333 - val_loss: 0.5340 - lr: 3.6979e-06
Epoch 67/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5329 - val_loss: 0.5340 - lr: 3.3460e-06
Epoch 68/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5338 - val_loss: 0.5340 - lr: 3.0276e-06
Epoch 69/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5347 - val_loss: 0.5339 - lr: 2.7394e-06
Epoch 70/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5341 - val_loss: 0.5339 - lr: 2.4788e-06
Epoch 71/100
51/51 [==============================] - 0s 7ms/step - loss: 0.5347 - val_loss: 0.5339 - lr: 2.2429e-06
Epoch 72/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5349 - val_loss: 0.5339 - lr: 2.0294e-06
Epoch 73/100
51/51 [==============================] - 0s 9ms/step - loss: 0.5349 - val_loss: 0.5339 - lr: 1.8363e-06
Epoch 74/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5334 - val_loss: 0.5339 - lr: 1.6616e-06
Epoch 75/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5331 - val_loss: 0.5338 - lr: 1.5034e-06
Epoch 76/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5340 - val_loss: 0.5339 - lr: 1.3604e-06
Epoch 77/100
51/51 [==============================] - 0s 9ms/step - loss: 0.5344 - val_loss: 0.5338 - lr: 1.2309e-06
Epoch 78/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5344 - val_loss: 0.5338 - lr: 1.1138e-06
Epoch 79/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5346 - val_loss: 0.5338 - lr: 1.0078e-06
Epoch 80/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5343 - val_loss: 0.5338 - lr: 9.1188e-07
Epoch 81/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5347 - val_loss: 0.5338 - lr: 8.2511e-07
Epoch 82/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5342 - val_loss: 0.5338 - lr: 7.4659e-07
Epoch 83/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5345 - val_loss: 0.5338 - lr: 6.7554e-07
Epoch 84/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5336 - val_loss: 0.5338 - lr: 6.1125e-07
Epoch 85/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5345 - val_loss: 0.5338 - lr: 5.5308e-07
Epoch 86/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5340 - val_loss: 0.5338 - lr: 5.0045e-07
Epoch 87/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5336 - val_loss: 0.5338 - lr: 4.5283e-07
Epoch 88/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5337 - val_loss: 0.5338 - lr: 4.0974e-07
Epoch 89/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5342 - val_loss: 0.5338 - lr: 3.7074e-07
Epoch 90/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5330 - val_loss: 0.5338 - lr: 3.3546e-07
Epoch 91/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5346 - val_loss: 0.5338 - lr: 3.0354e-07
Epoch 92/100
51/51 [==============================] - 0s 9ms/step - loss: 0.5355 - val_loss: 0.5338 - lr: 2.7465e-07
Epoch 93/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5331 - val_loss: 0.5338 - lr: 2.4852e-07
Epoch 94/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5344 - val_loss: 0.5338 - lr: 2.2487e-07
Epoch 95/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5337 - val_loss: 0.5338 - lr: 2.0347e-07
Epoch 96/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5346 - val_loss: 0.5338 - lr: 1.8411e-07
Epoch 97/100
51/51 [==============================] - 0s 9ms/step - loss: 0.5332 - val_loss: 0.5338 - lr: 1.6659e-07
Epoch 98/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5339 - val_loss: 0.5338 - lr: 1.5073e-07
Epoch 99/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5346 - val_loss: 0.5338 - lr: 1.3639e-07
Epoch 100/100
51/51 [==============================] - 0s 8ms/step - loss: 0.5338 - val_loss: 0.5338 - lr: 1.2341e-07

 42/102 [===========>..................] - ETA: 0s 
2023-11-26 23:51:06.146490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:06.146875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:06.147283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:06.207907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:06.208415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:06.208836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 0s 1ms/step
10/10 [==============================] - 0s 1ms/step
Training Metrics:
MAE: 0.5225631519293051, RMSE: 0.6916677302601856, R2: 0.09528052136742404

Test Metrics:
MAE: 0.5240207566874231, RMSE: 0.6580063139051432, R2: -0.10124548814188006
Code
def scheduler(epoch, lr):
    if epoch < 10:
        return lr
    else:
        return lr * np.exp(-0.1 * (epoch // 10))  # More aggressive decay every 10 epochs

# Adjusting the regularization strengths and dropout rates
def build_model(input_shape, output_units=1, neurons=16, dropout=0.3, l1_reg=0.0001, l2_reg=0.0001):
    model = Sequential()
    model.add(LSTM(neurons, return_sequences=True, input_shape=input_shape,
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(LSTM(neurons, return_sequences=False, 
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(Dense(output_units))
    
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')
    return model

# Callbacks
lr_schedule = LearningRateScheduler(scheduler)
early_stopping = EarlyStopping(monitor='val_loss', patience=20, restore_best_weights=True)

# Assuming x_train, y_train, x_test, y_test, and sequence_length are already defined
input_shape = (sequence_length, x_train.shape[2])

# Experimenting with different batch sizes
batch_sizes = [32, 64, 128]

for batch_size in batch_sizes:
    model = build_model(input_shape)
    history = model.fit(
        x_train, y_train,
        epochs=100,
        batch_size=batch_size,
        validation_data=(x_test, y_test),
        shuffle=False,
        callbacks=[lr_schedule, early_stopping]
    )

    # Plot the training and validation loss
    plt.plot(history.history['loss'], label='train')
    plt.plot(history.history['val_loss'], label='test')
    plt.title(f'Batch Size: {batch_size}')
    plt.legend()
    plt.show()

    # Generate predictions
    train_pred = model.predict(x_train)
    test_pred = model.predict(x_test)

    # Calculate metrics
    train_mae = mean_absolute_error(y_train, train_pred)
    train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
    train_r2 = r2_score(y_train, train_pred)

    test_mae = mean_absolute_error(y_test, test_pred)
    test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
    test_r2 = r2_score(y_test, test_pred)

    print(f"Batch Size: {batch_size}")
    print("Training Metrics:")
    print(f"MAE: {train_mae}, RMSE: {train_rmse}, R2: {train_r2}")

    print("\nTest Metrics:")
    print(f"MAE: {test_mae}, RMSE: {test_rmse}, R2: {test_r2}")
Epoch 1/100
2023-11-26 23:51:10.125851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:10.126263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:10.126878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:10.182079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:10.182549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:10.182968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:10.264026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:10.264548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:10.265036: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:10.325847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:10.326365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:10.326832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:10.580856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:10.581476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:10.582137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:10.642865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:10.643296: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:10.643731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 1s 6ms/step - loss: 0.5972 - val_loss: 0.5698 - lr: 0.0010
Epoch 2/100
  1/102 [..............................] - ETA: 0s - loss: 0.2259
2023-11-26 23:51:11.495149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:11.495646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:11.496312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:11.567195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:11.568153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:11.568699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 0s 3ms/step - loss: 0.5608 - val_loss: 0.5579 - lr: 0.0010
Epoch 3/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5535 - val_loss: 0.5556 - lr: 0.0010
Epoch 4/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5476 - val_loss: 0.5416 - lr: 0.0010
Epoch 5/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5411 - val_loss: 0.5386 - lr: 0.0010
Epoch 6/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5327 - val_loss: 0.5413 - lr: 0.0010
Epoch 7/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5284 - val_loss: 0.5470 - lr: 0.0010
Epoch 8/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5260 - val_loss: 0.5435 - lr: 0.0010
Epoch 9/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5218 - val_loss: 0.5421 - lr: 0.0010
Epoch 10/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5170 - val_loss: 0.5421 - lr: 0.0010
Epoch 11/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5138 - val_loss: 0.5428 - lr: 9.0484e-04
Epoch 12/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5147 - val_loss: 0.5361 - lr: 8.1873e-04
Epoch 13/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5064 - val_loss: 0.5332 - lr: 7.4082e-04
Epoch 14/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5052 - val_loss: 0.5316 - lr: 6.7032e-04
Epoch 15/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5031 - val_loss: 0.5313 - lr: 6.0653e-04
Epoch 16/100
102/102 [==============================] - 0s 3ms/step - loss: 0.5026 - val_loss: 0.5240 - lr: 5.4881e-04
Epoch 17/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4992 - val_loss: 0.5241 - lr: 4.9659e-04
Epoch 18/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4957 - val_loss: 0.5202 - lr: 4.4933e-04
Epoch 19/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4939 - val_loss: 0.5164 - lr: 4.0657e-04
Epoch 20/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4919 - val_loss: 0.5165 - lr: 3.6788e-04
Epoch 21/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4927 - val_loss: 0.5187 - lr: 3.0119e-04
Epoch 22/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4927 - val_loss: 0.5143 - lr: 2.4660e-04
Epoch 23/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4890 - val_loss: 0.5147 - lr: 2.0190e-04
Epoch 24/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4894 - val_loss: 0.5145 - lr: 1.6530e-04
Epoch 25/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4870 - val_loss: 0.5138 - lr: 1.3534e-04
Epoch 26/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4908 - val_loss: 0.5126 - lr: 1.1080e-04
Epoch 27/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4873 - val_loss: 0.5115 - lr: 9.0718e-05
Epoch 28/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4857 - val_loss: 0.5107 - lr: 7.4274e-05
Epoch 29/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4847 - val_loss: 0.5110 - lr: 6.0810e-05
Epoch 30/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4850 - val_loss: 0.5110 - lr: 4.9787e-05
Epoch 31/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4843 - val_loss: 0.5108 - lr: 3.6883e-05
Epoch 32/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4827 - val_loss: 0.5105 - lr: 2.7324e-05
Epoch 33/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4849 - val_loss: 0.5106 - lr: 2.0242e-05
Epoch 34/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4844 - val_loss: 0.5105 - lr: 1.4996e-05
Epoch 35/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4835 - val_loss: 0.5103 - lr: 1.1109e-05
Epoch 36/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4828 - val_loss: 0.5102 - lr: 8.2297e-06
Epoch 37/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4814 - val_loss: 0.5101 - lr: 6.0967e-06
Epoch 38/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4805 - val_loss: 0.5100 - lr: 4.5166e-06
Epoch 39/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4841 - val_loss: 0.5100 - lr: 3.3460e-06
Epoch 40/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4831 - val_loss: 0.5100 - lr: 2.4788e-06
Epoch 41/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4831 - val_loss: 0.5100 - lr: 1.6616e-06
Epoch 42/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4849 - val_loss: 0.5100 - lr: 1.1138e-06
Epoch 43/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4845 - val_loss: 0.5099 - lr: 7.4659e-07
Epoch 44/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4849 - val_loss: 0.5099 - lr: 5.0045e-07
Epoch 45/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4838 - val_loss: 0.5099 - lr: 3.3546e-07
Epoch 46/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4868 - val_loss: 0.5099 - lr: 2.2487e-07
Epoch 47/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4841 - val_loss: 0.5099 - lr: 1.5073e-07
Epoch 48/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4826 - val_loss: 0.5099 - lr: 1.0104e-07
Epoch 49/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4853 - val_loss: 0.5099 - lr: 6.7729e-08
Epoch 50/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4840 - val_loss: 0.5099 - lr: 4.5400e-08
Epoch 51/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4828 - val_loss: 0.5099 - lr: 2.7536e-08
Epoch 52/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4821 - val_loss: 0.5099 - lr: 1.6702e-08
Epoch 53/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4841 - val_loss: 0.5099 - lr: 1.0130e-08
Epoch 54/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4859 - val_loss: 0.5099 - lr: 6.1442e-09
Epoch 55/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4859 - val_loss: 0.5099 - lr: 3.7267e-09
Epoch 56/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4864 - val_loss: 0.5099 - lr: 2.2603e-09
Epoch 57/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4835 - val_loss: 0.5099 - lr: 1.3710e-09
Epoch 58/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4847 - val_loss: 0.5099 - lr: 8.3153e-10
Epoch 59/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4851 - val_loss: 0.5099 - lr: 5.0435e-10
Epoch 60/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4844 - val_loss: 0.5099 - lr: 3.0590e-10
Epoch 61/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4846 - val_loss: 0.5099 - lr: 1.6788e-10
Epoch 62/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4868 - val_loss: 0.5099 - lr: 9.2136e-11
Epoch 63/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4849 - val_loss: 0.5099 - lr: 5.0565e-11
Epoch 64/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4815 - val_loss: 0.5099 - lr: 2.7751e-11
Epoch 65/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4833 - val_loss: 0.5099 - lr: 1.5230e-11
Epoch 66/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4856 - val_loss: 0.5099 - lr: 8.3584e-12
Epoch 67/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4843 - val_loss: 0.5099 - lr: 4.5872e-12
Epoch 68/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4864 - val_loss: 0.5099 - lr: 2.5175e-12
Epoch 69/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4842 - val_loss: 0.5099 - lr: 1.3816e-12
Epoch 70/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4844 - val_loss: 0.5099 - lr: 7.5826e-13
Epoch 71/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4883 - val_loss: 0.5099 - lr: 3.7654e-13
Epoch 72/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4847 - val_loss: 0.5099 - lr: 1.8698e-13
Epoch 73/100
102/102 [==============================] - 0s 3ms/step - loss: 0.4838 - val_loss: 0.5099 - lr: 9.2853e-14

 71/102 [===================>..........] - ETA: 0s 
2023-11-26 23:51:32.084947: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.085470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.085845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:32.145605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.145985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.146324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 0s 699us/step
10/10 [==============================] - 0s 689us/step
Batch Size: 32
Training Metrics:
MAE: 0.4551515663257481, RMSE: 0.6409575726452644, R2: 0.22307789477692697

Test Metrics:
MAE: 0.49501844114884663, RMSE: 0.6070457313801763, R2: 0.06272541816261445
Epoch 1/100
2023-11-26 23:51:32.376787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.377219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.377771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:32.433298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.433710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.434061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:32.527733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.528237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.528688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:32.593487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.594156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.594648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:32.838995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.839454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.839883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:32.905327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:32.905838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:32.906242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 1s 9ms/step - loss: 0.6046 - val_loss: 0.5789 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.2335
2023-11-26 23:51:33.663111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:33.663706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:33.664162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:33.737429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:33.737874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:33.738236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
51/51 [==============================] - 0s 3ms/step - loss: 0.5704 - val_loss: 0.5598 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5653 - val_loss: 0.5535 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5555 - val_loss: 0.5433 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5525 - val_loss: 0.5363 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5429 - val_loss: 0.5463 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5397 - val_loss: 0.5381 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5422 - val_loss: 0.5474 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5339 - val_loss: 0.5385 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5308 - val_loss: 0.5387 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5207 - val_loss: 0.5402 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5177 - val_loss: 0.5391 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5171 - val_loss: 0.5338 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5131 - val_loss: 0.5355 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5116 - val_loss: 0.5197 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5086 - val_loss: 0.5317 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5092 - val_loss: 0.5160 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5056 - val_loss: 0.5184 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5057 - val_loss: 0.5141 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5001 - val_loss: 0.5087 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5041 - val_loss: 0.5152 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5018 - val_loss: 0.5234 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5005 - val_loss: 0.5218 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4983 - val_loss: 0.5209 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.5008 - val_loss: 0.5169 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4973 - val_loss: 0.5173 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4970 - val_loss: 0.5151 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4961 - val_loss: 0.5142 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4955 - val_loss: 0.5129 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4950 - val_loss: 0.5127 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4976 - val_loss: 0.5132 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4977 - val_loss: 0.5128 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4945 - val_loss: 0.5125 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4972 - val_loss: 0.5127 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4943 - val_loss: 0.5128 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4974 - val_loss: 0.5129 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4976 - val_loss: 0.5129 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4968 - val_loss: 0.5129 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4956 - val_loss: 0.5130 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.4989 - val_loss: 0.5131 - lr: 2.4788e-06

  1/102 [..............................] - ETA: 22s
2023-11-26 23:51:40.324747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:40.325703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:40.326110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:40.390898: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:40.391684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:40.392191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 0s 687us/step
10/10 [==============================] - 0s 677us/step
Batch Size: 64
Training Metrics:
MAE: 0.4640070779594649, RMSE: 0.6479920562747955, R2: 0.2059309368753861

Test Metrics:
MAE: 0.4908322869306443, RMSE: 0.6066219777295254, R2: 0.06403350709213851
Epoch 1/100
2023-11-26 23:51:40.630054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:40.630545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:40.630958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:40.682462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:40.682878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:40.683255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:40.767598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:40.768085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:40.768487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:40.829048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:40.829559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:40.829985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:41.094494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:41.095213: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:41.095668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:41.160081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:41.160573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:41.161034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 1s 14ms/step - loss: 0.6092 - val_loss: 0.5716 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.3187
2023-11-26 23:51:41.819493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:41.820081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:41.820488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:41.887542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:41.888031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:41.888434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
26/26 [==============================] - 0s 4ms/step - loss: 0.5627 - val_loss: 0.5311 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5559 - val_loss: 0.5299 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5508 - val_loss: 0.5298 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5482 - val_loss: 0.5266 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5474 - val_loss: 0.5236 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5432 - val_loss: 0.5226 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5383 - val_loss: 0.5181 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5366 - val_loss: 0.5214 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5361 - val_loss: 0.5191 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5321 - val_loss: 0.5159 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5292 - val_loss: 0.5138 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5270 - val_loss: 0.5179 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5221 - val_loss: 0.5205 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5201 - val_loss: 0.5195 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5188 - val_loss: 0.5183 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5141 - val_loss: 0.5134 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5122 - val_loss: 0.5112 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5105 - val_loss: 0.5136 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5156 - val_loss: 0.5185 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5091 - val_loss: 0.5175 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5096 - val_loss: 0.5151 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5081 - val_loss: 0.5138 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5096 - val_loss: 0.5134 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5055 - val_loss: 0.5131 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5083 - val_loss: 0.5143 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5055 - val_loss: 0.5141 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5078 - val_loss: 0.5136 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5074 - val_loss: 0.5137 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5080 - val_loss: 0.5145 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5086 - val_loss: 0.5146 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5088 - val_loss: 0.5144 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5066 - val_loss: 0.5141 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5076 - val_loss: 0.5140 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5069 - val_loss: 0.5139 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5081 - val_loss: 0.5139 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5090 - val_loss: 0.5138 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.5060 - val_loss: 0.5138 - lr: 4.5166e-06

 69/102 [===================>..........] - ETA: 0s 
2023-11-26 23:51:45.933674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:45.934189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:45.934743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-26 23:51:45.996194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-26 23:51:45.996606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-26 23:51:45.997315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
102/102 [==============================] - 0s 728us/step
10/10 [==============================] - 0s 686us/step
Batch Size: 128
Training Metrics:
MAE: 0.4822559478710052, RMSE: 0.6596517540357565, R2: 0.17709754942751066

Test Metrics:
MAE: 0.4933750076249008, RMSE: 0.6098230742354798, R2: 0.054129401000154065